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Abstract 


Loo8(>ly  Hponking,  rocursivo  inforoiioc  in  wlion  <u>  infcrciico  procedure  gciior- 
at.e8  an  iniluite  Hoqurnre  of  Hiinilnr  8\ibgonlH.  In  general,  the  control  of  re> 
curHive  inference  involvcfi  deinonstratiug  that  recurnive  portions  of  a  search 
space  will  not  contributt'  any  new  iuwwers  to  the  problem  beyond  a  cer¬ 
tain  level.  Wo  first  review  a  well  known  syiitartir  method  for  controlling 
repeating  inference  (inferc’ucc  where  the  eonjuncts  processed  arc  instances 
of  tlieir  ancc'stors),  provide  a  proof  that  it  is  correct,  and  discuss  the  con¬ 
ditions  under  which  the  strategy  is  optimal.  We  also  derive  more  powerful 
pruning  theorems  for  cases  involving  transitivity  axioms  and  cases  involv¬ 
ing  siibsiinied  subgoals.  Tlie  trc'atment  of  repeating  inference  is  followed  by 
consideration  of  tin'  more  difficult  i)roblem  of  recursive  inference  that  do<» 
not  r('i)eat.  Hiti>  we  show  how  knowh'dge  of  the  propw'ties  of  the  ndations 
involved  and  knowh'dge  about  the  contents  of  the  system’s  database  can  be 
used  to  prove  that  portions  of  a  soju'ch  spact;  wili  not  <routribnt(!  any  now 
answers. 
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i  INTRODUCTION 


Conn[AyZ) 


Conn(  A,  y)  Conn{y^  z) 


Conn{A,y*)  Conn{y\y)  Conn[y,w)  Conn{w,z) 


Conn{A,  j/'')  Conn{y*\  2/')  Conn{y,  ^y')  Conn{ii/,  t^;) 

Figure  1-1:  A  portion  of  the  backward  scwch  space  for  the  goal  Conn{A,  z) 

1  Introduction 

1.1  Motivation 

Consider  a  systc'in  for  reasoning  about  circuits  based  on  descriptions  of  cir¬ 
cuit  to})ology  and  tlu'  functional  clmracteristics  of  circuit  elements.  Such  a 
syst('in  might  ne('d  to  know  that  coniurtion  between  terminals  in  a  circuit 
is  transitive  and  syjiinu'tric, 

(^fmn{x,  y)  A  Conn{y,  z)  ==>  Conn{x,  z)  n  -  H 

(Umn{xyy)  <==>  Conn[y^x)  ^  ^ 

where  the  proposition  Conn{x^y)  means  the  point  x  is  ehTtrically  connected 
to  the  point  y  in  the  circuit.  The  proldem  with  such  facts  is  that  they 
often  result  in  infinite  searches.  Sui)pos(',  for  iiistmice,  that  we  want  to 
find  all  of  the  connections  to  some  point  A  in  a  circuit.  A  portion  of  the 
backwm'd  AND/OR  search  tree  for  this  i)robl(?m  is  shown  in  Figure  1-1. 
A})plying  the  transitivity  rule  to  the  query  C’onn(A,  z)  results  in  the  subgoal 
Conn{A,y)  A  C()7in{yyz),  Tlie  transitivity  nile  am  be  apjdied  again  to 
both  of  these  conjuncts  yu'ldijig  the  subgoals  Conn(A^y*)  AC(mn{y\y)  and 
Conn{y^7v)  AC()nn{w^z)  respectively.  Transitivity  ai)plies  again  to  each 
of  these  four  conjuncts,  and  vso  on.  For  this  problem  a  backward  inference 
procedure  would  ajqdy  the  transitivity  rule  agcain,  and  again,  <md  ag<vin 
until  it  runs  out  of  storag(',  the  us(?r  runs  out  of  patience  or  money,  or  the 
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machine  crashes.  The  entire  space  need  not  he  examined  in  order  to  find  all 
of  the  answers  to  this  prohlein.  However,  th<'  ainomit  of  the  search  space 
that  must  be  examined  depends  upon  what  comu'ctivity  facts  arc  present 
in  the  the  system’s  database.  In  this  pajx'r  we  will  consider  the  problem  of 
how  to  prune  the  senj-ch  space  for  such  recursive  problems. 


1.2  Cheap  Tricks 

It  might  seem  that  there  are  simple  solutions  to  the  problem  given  above. 
Let’s  consider  the  i)ossibilities. 

1.2.1  Forward  Inference 

If  forward  inference  were  performed  on  all  facts  of  the  form  Conn{a,b)  using 
tlu'  transitivity  rule,  and  the  transitivity  ruh?  were  not  used  for  backward 
inference,  the  })roblem  would  be  eliminated.  Unfortunately,  there  are  several 
serious  diiiiemltievs  with  this  approach.  First  of  all,  even  the  restricted  use 
of  forwai'd  inferi'iice  can  result  in  the  fotni)utation  and  storage  of  many 
irn'levjuit  facts.  For  the  example  above,  fenward  inference  would  result  in 
computation  of  the  transitivi'  clositre  of  all  connections  in  the  circuit,  even 
though  we  may  only  lu'od  to  know  the  c.onm'ctions  to  a  few.  This  would  be 
unacceptable  for  c.as<>s  of  high  ffui-out  or  hui-in,  lik('  coinu’ctions  to  common 
bussc's,  power  supplies,  or  groumls.  Secondly,  <is  Minker  and  Nicolas  (MN83] 
{uid  Ib'il.c'r  |R('i78]  have'  i>oinl.ed  out,  selective  use  of  forw.-ud  inference  can 
result,  in  iiicompl(*ten<>ss  in  tlie  inference  process.  For  the  (example  above, 
snjipose  it  were  possible!  to  conclude  tlu'  coniu'ctivity  of  <‘<*rtain  points  using 
other  eixioms.  Unless  th<!se  axioms  are  also  subjeK’l;  to  forward  infi'n'iice,  the 
tnuisitiv(!  closure  of  connections  derivable'  by  tlujse  axioms  will  not  bo  found. 
Finally,  there  ivrc  cases  where  both  forwtird  and  bfwkward  iuferejneo  can 
result  in  infinite  search  spaces.  Conside'r  the  rule  for  ce)inputing  Fibonacci 
numbers: 

X  =  Fibonacci{i  -  2)  A  y  =  Fib<m(icci{i  —  l)Az  =  x  +  y  f  i  _  2I 
=»  Fibonacci {i)  —  z  \  I 

Whe'u  twe)  Fibonae:e:i  numbe'rs  are  give'ii  to  a  forwarel  infe'reiiice!  proceelure  it 
would  pre)ce'e(l  to  ce)mi>ut.e!  Fibonacci  nuiubors  foreve'r.  This  rule  can  cause 
an  infinite  le)e)p  in  e!ither  a  backwarel  or  forwarel  infe're’uco  e'ligine.  Thus,  the 
iise  of  forwarel  inferemcc  is  hot  a  good  solution  to  the  pre)blem  of  recursive 
iufcrcucc. 
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1.2.2  Eliminating  Repeating  Goals 

This  doesn’t  work  in  gonc'ral.  For  the  connectivity  example,  if  the  database 
contains  the  facts, 

C'onn(i4,  B) 

Conn{D,C) 

Conn{C,  D) 

it  is  necessary  to  search  3  levels  de('p  in  the  si)ace  in  order  to  find  all  of  the 
connections  to  A.  If  rejicating  goals  arc  piMined,  sonic  of  the  answers  will 
be  lost.  In  Section  3  we  will  discuss  some  special  cases  where  this  strategy 
is  correct. 

1.2.3  Breadth-First  Search 

Unfortunately,  breadth-first  sc'arch  does  not  help  if  there  are  not  any  solu¬ 
tions  to  the  problem  or  if  the  problem  involves  finding  all  solutions  to  a  goal. 
In  both  eases  the  entire'  space  must  bo  searelu'd.  A  complete  bre'adtli-first 
search  of  an  infinite  search  space  is  just  as  bad  as  a  complete  depth-first 
search. 


1.2.4  Reformulation 

The'  t('chni<iu(’  of  n’foruiulation  is  one'  (juife'  familiar  lo  PROLOG  program¬ 
mers.  It  involves  n'writing  the  facts  available  to  Ihe  infen'iice  procedure 
so  that  (be  search  sjiace'  for  the  goal  is  no  louge'r  infinite,  or  so  thal  the 
inferences  proci'dun'  will  not  discover  the  recursive  portion.  As  an  example 
of  what  we  mean  by  rr.forrnulation,  cousi<ler  th<'  troublesome  transitivity 
nde  (I-l)  for  circuit  connections.  By  introtlucing  a  lusw  relation,  IConn, 
meaning  “iinm('<liat cly  comu'ctcd” ,  the  tr;msitivity  nde  can  bo  n'written  as 
two  separate  rules: 

IConn{x,y)  =>•  Conn{x,y) 

IConn{x,y)  A  Conn{y,  z)  =>  Conn{x,z) 

For  this  revised  set  of  rules,  the  search  space  for  the  goal  proposition 
Conn{A,z)  is  shown  in  Figure  1-2.  With  this  reformulation,  we  have  elimi- 
na(<'<l  llu'  n'cursion  on  all  h‘ft,-hand  hr  .inches  of  the  tn'e.  Of  course,  for  this 
reformulation  to  work,  all  avail.able  connecl.ions  must  b<>  expressed  in  terms 
of  IConn,  r.ither  than  in  terms  of  Conn.  However,  given  liiese  relatively 
minor  changes,  this  r<*vis('d  s('t  of  rules  will  never  hvid  to  an  uifinite  search, 
so  long  as  th<'  IConn  conjunct  is  always  solved  before  the  Conn  conjunct. 
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Conn{A,z) 


IConn{A,z)  IConn{A,y)  Conn{y,z) 


IConn{y,z)  IConn{y,y')  Conn{y\z) 


Figure  1-2:  Rofonimlatcd  scwrch  spaco  for  the  gosil  Conn(/l,«) 


While  tho  above  roforniulalion  works  well  for  the  (jiiery  Conn{A,  z),  it 
does  not  work  well  for  th<‘  query  C«nn(x,  D).  On  applying  the  reformulated 
version,  we  wcuild  get  the  subgoal  IConn{x,y)  A  Conn[y,  D).  If  the  IConn 
coiijiinet  is  expanded  first  we  end  up  secirehing  through  all  of  the  innuediate 
connectioiis  in  the  circuit;  a  horribly  inefficient  proex'ss  in  a  large  circuit, 
Alt(>rnatively,  if  the  Conn  conjunct  is  (>xpanded  first,  we  again  end  up  with 
an  infinit(*ly  rejM'ating  search  spac(\  Tin*  dual  reformulation, 

IConn('X,y)  —=>■  Conn(:r,,y) 

IConn{y,  z)  A  ('onn{x,  y)  =>  C'onn(i,  z) 

works  lin<>  for  th<'  query  Conn{x,  D),  Init  ix-rfonns  miserably  for  tho  qjiery 
Conn(A,z).  Neitln'r  of  tlu'se  reformulations  are  reasonable  if  botlj  kinds  of 
querioH  arc  expected,  as  might  be  th('  case  for  an  asymmetric  relation.  In 
general  reformulations  only  work  effectively  for  some  subset  of  tho  possible 
queries  covertsd  by  the  original  domain  knowledge. 

A  second  problem  with  reformulation  is  that  it  can  be  an  arbitrarily 
difficult  programming  task,  (kmsidcr  the  recursive  rule  that  states  that  a 
person  will  be  an  jdbino  if  both  his  parents  are  albinos. 

Albinoi'x)  A  Parents{z)  =  {.r.y}  A  Altmo{y)  =>  Albino{z)  (1  -  3) 
Suppose  that  the  (piery  is  to  find  all  albinos. 

hud  Jill  z:  Albmo(z) 
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Expanding  tlic  parents  conjunct  first  would  result  in  an  unacceptable  search 
throtigli  all  parent/child  i)airs.  Alternatively,  expanding  either  of  the  al¬ 
bino  conjuncts  first  would  result  in  an  infinite  repeating  sciu-ch  space.  By 
indulging  in  knowledge  programming,  we  could  reformulate  this  rule  so  that 
depth-first,  backward  inft'rc'iice  results  in  an  efficient  search  of  the  si)ace 
for  this  query.  As  a  first  step,  in  (1-4)  we  introduce  the  new  predicate 
GivenAlhino(x)  to  n'fer  to  those  individuals  given  as  albinos  initially.  The 
first  two  rules  below  state  that  any  given  albino  is  an  albino,  and  that  any 
gcner.ation  descendc'iit  of  a  given  albino  (along  albino  lines)  is  also  an 
albino.  Wo  still  need  to  define  what  it  means  for  an  individual  to  be  of 
albino  dc'seent  from  a  given  albino.  The  third  rule  states  that  an  individual 
is  of  albino  <lescent  from  a  given  albino  if  the  given  albino  is  a  pai-(;nt  of  the 
individual,  and  th(i  oth(!r  individual’s  parent  is  fui  albino.  The  fourth  rule 
simply  cxprc'sses  th('  transitive  closure  of  this  relationship,  that  an  individ¬ 
ual  is  of  iilbino  descent  from  a  given  albino  if  that  individual  is  of  albino 
descent  from  the  givens  albino  children.  The  final  two  rules  are  for  check¬ 
ing  whether  a  given  individual  is  an  albino  ruid  are  identical  to  the  original 
albino  rule  (1-3). 

Given  Albino  [z)  =>  Allnno{z) 

Given Albino{x)  A  AlhinoDescent{z,  x)  =>  Alhino{z) 

Parenttf{z)  =  {x,y}  A  Check Alhino{y)  =>  AlhinoDcscent[z,x) 

Parents[^n)  —  {x.y}  A  ChexkAlbino{y)  ft  —  4l 

A  AlbinoDcticcnt{z,w)  AlbinoDct^ccnt(z,x) 

Given Albino{z)  =>  CheckAlbino{z) 

Parentn{z)  =  {^-^y}  ACheckAlbino{x) 

A  CheckAlbino{y)  ==>  CheckAlbino{z) 

Performing  depth-first  backwfird  inh'rence  on  this  reformulation  results 
in  forwiud  inference  from  given  albinos  ho  their  jjrogcny,  and  backward  in¬ 
ference  at  each  stc'p  to  verify  that  (he  otlu'r  p;vr<'ut  of  the  progeny  is  also 
<'Ui  albino.  Note  that  this  backward  portion  of  the  infc'rence  is  accomplished 
using  the  original  albino  rule  (1-3)  (which  is  rewritten  using  a  different 
predicate'  to  dislinguish  it  from  our  reformulated  version).  As  with  the  con¬ 
nectivity  exam])le,  this  reformulation  only  works  {'fficiently  for  the  query 
Albino{z),  where  one  or  more'  albinos  are'  ele'sireel.  It  ele)es  ne)t  work  well  for 
e-heM'king  whe'the'r  a  give'ti  indivielual  is  an  albino. 
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From  tli<;s<'  ('xmiiplos,  wo  enn  sch'  Mint  thoro  ar(^  sovc^al  serious  disadvan¬ 
tages  to  reformulation  as  a  method  of  eoutrolliiig  recursive  inference.  First, 
the  resulting  kiiowh'dge  programs  only  work  effectively  for  some  subset  of 
the  possible  (pua-ies  covered  by  the  original  domain  knowledge.  Second,  it 
may  be  an  arbitrarily  difficult  programming  task  to  do  such  a  reformula¬ 
tion.  Finally,  it  is  more  difficult  to  uiuh’rstiuid,  explain,  and  modify  re¬ 
formulations.  Reformulation  results  in  an  implicit  embedding  of  control 
informat  ion  into  tin;  domain  inhumation.  Instead  of  having  facts  about  the 
domain  and  facts  abotit  control,  the  two  are  merged  into  knowledge-rich  pro¬ 
grams  for  a  given  interpreter.  This  has  little  advantage  over  building  expert 
systems  in  more  traditional  i)rt)gramming  languages  like  LISP  or  PASCAL. 
Many  authors  have  m-gued  agmnst  reformtilation  for  exactly  these  reasons 
[McC68,ITay73,Dav80.Doy8(),(lla83,GS8r)].  The  albino  reformulation  (1-4) 
leave's  much  to  be  desircMl  when  compared  with  tlu'  original  straightforwjvrd 
domain  rule  (1-3). 

1.3  Definitions 

So  far  we  hav('  relied  on  tlu?  rc'aders  intuitions  <md  the  examples  to  indicate 
what  w<'  might  mean  by  the  t(?rm  recursive  iiiferonre.  We  now  give  a  precise 
definition. 

Let  the  term  goal  set  refer  l.o  the  set  of  all  conjuncts  for  a  conjunctive  goal 
in  a  search  space.  We  say  that  out?  goal  st't  </'  is  a  (hscendant  of  juiother  goal 
set  f/,  if  there  is  some  setpience  of  goal  sets  beginning  with  t/  and  ending  with 
</',  such  t  hat  each  goal  st't  in  the  setiiit'nce  is  a  Bubgt)al  of  its  predecessor. 
An  exprt'ssit)!)  c*  is  said  to  be  an  inslnnce  t)f  an  exprt'ssion  c  if  there  is  a 
substitution  (a  set.  of  bijitliiigs)  6  ft>r  tiu'  variabh's  in  c  such  that  c*  =  cj^. 
An  inference  path  in  a  search  space  is  a  sequenct'  of  gt)al  sets  in  the  space 
such  that  each  gotd  set  in  the  sctiuenco  is  an  (immediate)  subgoal  of  the 
preceding  goal  st't.  For  example,  the  sctiueiicc 

{Conn{A,2)} 

{Corm{A,y),Conn{y,z)) 

{Conn{A,y'),Conn{y\y),Conn{y,z)) 

• 

is  <vn  inf(?reucc  path  for  tlu?  coniu'ctivity  prt)blcm. 

Definition  1.1  An  inference  path  is  rt'cursivt?  if  there  is  an  infinite  subse¬ 
quence  (j/i, . . .  jfft,  •  •  •)  of  the  goal  sets  in  the  path  and  a  distinguished  clause 
Ci  in  each  goal  set  such  that, 
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1.  Ci  is  an  instance  of  ci  X;,  and 

2.  Ci  is  in  the  subset  of  gi  that  arc  descendants  of  Cj- 1. 

An  inference  procedure  generating  any  recursive  inference  path  is  said  to  be 
involved  in  recursive  inference. 

The  first  criterion  in  tlu?  definition  restricts  us  to  those  ])aths  where  the  same 
conjunct  is  generated  over  and  over  again.  The  second  criterion  prevents  us 
from  considering  conjnncts  that  have  not  had  any  inference  performed  on 
thc'rn  yet. 

As  nn  oxam])lc,  consider  the  infinite  inference  path  (1-5)  for  the  con¬ 
nectivity  problem.  The  conjunct  Conri(yl, ;//)  in  the  second  goal  set  is  an 
instance  of  th('  conjunct  Conn(A^  z)  in  th(^  first  goal  set.  The  descendants 
of  Conn(A,  z)  constitute  the  entire  set  {Conn(  A,  y),Conn{y,  2r)},  which  con- 
tiiins  Conn(A,y).  Likewise,  the  conjunct  Conn(A,?/')  in  the  third  goal  set 
is  an  instance  of  tlu'  conjunct  C''onn(A,  ?y)  in  the  scrond  goal  set.  The  de¬ 
scendants  of  (7onn(A, ?/)  are  the  subset  {(Umn{A,y*),Conn{y\y)}^  which 
contains  fV>nn(A,2/').  Thus,  with  gi  as  the  goal  set  in  the  inference  path 
and  Ci  as  the  first  conjtinct  in  each  goal  set,  the  inference  path  satisfies  the 
definition  for  a  recursive  path. 

The  d('iinition  of  n'cursive  inf<Tenc('  that  we  hav('  just  given  actually 
covers  a  niucb  broaden*  class  of  probknjis  than  we  have  considered  so  far.  For 
('xani])l(',  1h(’  eh'linilion  includes  n'cursivi'  paths  wh<M(‘  there'  are  iiitenn(?diate 
d<\sc('ndants  in  ])('tw('en  those  descendants  with  rej)eating  conjnncts.  The 
dcdinitioii  also  inchnh's  paths  when'  tlu*  repc'at.ing  conjuiK't  may  have  its 
variables  bound  Ix'fore  it  is  actually  procc'sscnl.  Considen*  the  siini)le  axiom 

y  —  X  -[■  1  A  Integer {x)  =>  Integer {y)  .  {1  —  6) 

with  the  query  Integer {2. H).  One  infi^rcnce  path  for  this  problem  is  shown 
in  Figure  1-3.  WIk'ii  tlu^  Integer  cojijuncts  cire  expanded,  they  arc  each 
different,  since  the  variable  x  is  already  bound.  The  subsequence  of  goals 

Integer{2.5) 

Integer  {1.5) 

Integer  {.5) 


1.3  DeBnitions 
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Int€g€r{2.b) 


2.5  =  I  +  1  A  Integer  {x) 


Integer  {1.5) 


1.5  =  X  +  1  A  Integer{x) 


Integer{.5) 


.5  =  X  +  1  A  lnteger(x) 

« 

Figure  1-3:  Inference  path  for  the  query  Integer{2.5). 
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(loos  not  ropcat.  Ilowovor,  tho  snbs(^qucnce 

2.5  =  X  +  1  A  Inteyer{x) 

1.5  =  X  +  1  A  Integer(x) 

.5  =  1  +  1  A  Integer  {x) 

satisfies  our  definition  for  recursive  infixcnce.  Each  inomber  contains  the 
conjunct  Integer (x),  which  is  both  an  instiujcc  and  a  descendant  of  the 
preceding  Integer [x)  conjunct. 

Although  both  the  integer  example  and  the  connectivity  example  con¬ 
stitute  n'cursive  inference,  there  is  an  iiujxutmit  diffenuicc  betwec'n  the  two 
('xami)les.  (Consider  tin?  sequence  madc^  up  of  the  conjuiicts  actually  pro- 
r('ss('d  by  the  inference  ('ugine  at  ('ach  step.  For  tlie  connectivity  (example 
this  sequence  repeats. 

Conn{A,z) 

Conn(A,y) 

Conn{A,y') 


In  other  words,  the  repc'ating  conjuiicts  C(mn[A,  <f>)  are  instances  of  their 
pre<lec<'ssors  at  th<'  tiiiu'  thc'y  are  actually  reduced  to  subgoals.  We  refer  to 
such  r('cursiv(?  iiih'rencc'  (wlu're  tlu^  s(*(im'iic<>  of  conjuncts  reduct'd  at  each 
stej)  is  reix'at  iug)  as  retailing  inference. 

In  contrast  ,  the  setpu'nce  of  conjuncts  for  the  inl.eg('r  exaiujilt'  dot's  not 
repeat. 

Integer  [2. b) 

2.5  =  X  +  1 
Integcr[\.h) 

1.5  =  x  +  l 
Integer{.h) 

.5  =  X  +  1 


The  argument  of  Intcger[x)  is  always  bound  before  the  conjunct  is  actually 
reductul  to  subgoals,  and  each  time  the  argument  is  bound  to  a  dilferent 
constant..  The  latter  (]ualification  is  inijmrtant.  It  is  still  jxissiblc  for  the 
sequence  of  goals  processt'd  to  be  repeating  even  t  hough  lUl  of  their  argu¬ 
ments  have  been  bound.  We  will  show  examplt's  of  this  in  Section  3.  We 
refer  to  all  non-rejx'ating,  rtnuirsivt'  inft'it'nce  as  divergent  inft+euce. 


1.4  The  Approach 
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1.4  The  Approach 

Control  of  reenrsivo  inference  inecuis  eliminating  those  portions  of  the  search 
space  that  arc  superfluous  or  redundant.  We  say  that  a  goal  is  superfluous  if 
there  are  no  facts  in  the  database  that  will  satisfy  it  or  any  of  its  descendants. 
For  a  p;u’ticiilar  prohlein  we  say  that  a  goal  g  is  redundant  with  another  goal 
g'  if  none  of  its  descendants  will  result  in  any  solutions  to  the  problem 
not.  productul  by  descendants  to  the  goal  g' .  The  difficulty  is  to  determine 
which  branches  of  a  search  space  .arc  indeed  superfluous  or  redundant.  If 
all  r(!cursivc  inference  were  unproductive  it  would  be  a  simple  matter  to 
provide  effective  control.  However,  as  we  illustrated  with  the  transitivity 
rule  there  an;  many  instances  where  a  limited  amount  of  recursive  inference 
is  nec<*ssary  in  ord('r  to  arrive  at  desired  juiswers.  If  too  much  of  a  recursive 
space  is  discarded,  important  answers  to  the  problem  are  lost.  Alternatively, 
if  not  enough  of  the  recursive  space  is  discarded,  valuable  problem  solving 
effort  is  wasted. 

In  g(>neral,  it  is  not  decidable  whether  or  not  a  given  portion  of  a  recursive 
search  si)ace  is  redundant.  However,  there  are  special  cases  where  it  is 
possible'  to  prove  nulundancy  withemt  comjdetely  exploring  the  space.  For 
repeating  iiderence,  a  simple  syntactic  solution  is  possible.  We  can  decide 
when  to  cut  off  inference  by  kwping  track  of  th('  answers  produced  with 
eac’ji  additional  level  of  reixitition.  For  divergent  inference  the  probhmi  is 
much  har<ler.  Here  W('  must  genc'rah'  automatic  proofs  that  no  answers 
exist  in  a  port.iou  of  the  search  si)a<'e.  Tlu'se  j)roofs  are  similar  to  proofs 
of  program  tc'rmination  using  well-founded  set.s.  They  recpiirc  information 
about,  the  pr<iperti<'s  of  the  n'lations  involved,  mid  about  the  content  of  the 
system’s  database.  Finally,  when'  ruh'  sets  are  commutative  and  each  set 
alone  cannot  produce  answers,  it  is  possible  to  generate  automatic  proofs 
that  no  novel  answers  will  appem  in  a  portion  of  the  search  space,  again  by 
making  use  of  knowledge  about  the  properties  of  the  relations  involved,  and 
about  the  contents  of  the  system’s  database. 

1.5  Organization 

The  next  section  is  a  bit  of  an  academic  digression.  In  it,  we  consider 
the  typ(!8  of  facts  that  make  recursive  inference  possible,  and  consider  the 
conditions  undej*  which  recursive  infert'iice  will  actually  occur.  The  reader 
more  inti'restcd  in  a  solution  to  the  problem  of  recursive  inference  can  skip 
ah('ad  to  Sections  3  and  4.  hi  Section  3,  techniipies  for  the  conmion  special 
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case  of  repenting  inference  aro  roviewod.  Although  sov<'ral  of  the  cilgorithms 
presented  are  not  novel,  we  consider  them  from  the  viewpoint  of  search 
control,  introduced  in  Section  1.4.  We  provid<?  a  proof  that  the  method  is 
correct  and  consider  the  conditions  under  which  such  a  strategy  is  optimal. 
In  addition,  mor(’  powerful  methods  for  dealing  with  cases  of  transitivity 
and  logical  subsumption  are  described. 

The  more  general  class  of  non-rci)eatiiig  recursive^  iiiftjnmce  is  consid¬ 
ered  in  Section  4.  Here  we  show  how  properties  of  the  relations  involved 
and  knowledge!  about  the  conteui  s  of  the  system’s  database  can  be  uscel  to 
demonstrate  that  a  portion  of  the  search  space  is  redundant.  Finally,  in 
Section  5  W('  consider  the  probh  lu  of  detecting  rectirsive  inference*  se)  that 
centre)!  can  be  institute!d  only  whe'n  ncce!ssary.  Redateel  work  is  also  dis¬ 
cussed. 
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2  The  Conditions  for  Recursive  Inference 

2.1  Cyclic  and  Recursive  Collections 

Suppose  that  a  set  of  facts  can  be  arranged  in  the  form, 

Fx'.  Lx  A  ^x  =>  jDj 
J’a !  Z(2  A  ia 


Ffi-i  I  ^n-l  A  0n-l  ■^'n 
Fn'.  Ln  A  =►  I-Ul 

whore  the  consequent,  ij,,  j  of  each  fact  Fi  unifies  with  the  premises  Li+x  i» 
its  successor  1 1,  and  the  consequent,  L'^^  x^  of  the  final  rule  Fn  unifies  with 
the  premise  Lx  in  the;  first  rule  Fx.  We  say  that  such  a  set  of  rules  forms  a 
cycle  and  constitutc's  a  cyclic  collection.^  For  example  the  set  of  rules, 

P(®)  ^  Q(a:) 

Q{D)  =>  P{A) 

form  a  cycle,  since  Q{x)  unifies  with  Q{D)  and  P(x)  unifies  with  P{A),  A 
rule  can  he  involvc'd  in  more  than  one  <‘ycl(*,  so  we  also  refer  to  the  union  of 
any  two  cyclic  collections  that  share  rules  as  a  cyclic  collection. 

If  a  common  set  of  bindings  is  possible  for  all  of  tin'  unifications  in  a 
cycl(<,  the  facts  are  said  to  be  rccureive  and  (tonsti<.ute  a  recunive  collection. 
In  other  words,  a  group  of  fm'ts  is  recursive  if  there  is  some  common  set 
of  bindings  h  for  the  variables  in  (vu;h  of  the  facts  Fx  through  Fn  such  that 
=  ^<1*  ttnd  I  jli,  =  Lili,.  (The  notation  P\b  refers  to  the  clause  P  under 
the  variable  bindings  b).  The  cyclic  collection  given  above  is  not  a  recursive 
collection  because  x  cannot  bo  botmd  to  both  A  and  B  simultaneously. 
However,  the  cyclic  collection 


P{x)  =>  Q{x) 

QM  =*  m 


iiotntioii  luul  tcraJnology  in  dorivod  frtari  Minkcr  mid  NicoliiH  [MN83].  Minkor 
luid  NicoIhh  rxproHH  ihim  dcfliiitionH  in  tcrinR  of  fiustH  in  coi^nnctivo  iioriiinl  fonn.  For 
Hiiaplicity  wo  Imvu  i^jirosHod  ihoHo  dolluitioiiH  in  torniH  of  nilos. 
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is  a  recursive  collection  since  the  binding  x  :  y  unifies  Q{x)  with  Q{y)  and 
P{x)  with  P(y).^  Lik(‘wise,  the  transitivity  ai\d  symmetry  rules,  the  albino 
rule,  and  the  Fibonacci  rule  givcjii  in  the  previous  section  arc  all  recursive 
collections. 

As  with  cyclic  collections,  it  is  possible  for  a  single  rule  to  be  p^irt  of 
more  than  one  n'cursive  (  ollection.  We  therefore  refer  to  th<‘  union  of  any 
two  recursive  collections  that  share  rules  as  a  recursive  collection. 


2.2  Recursive  Search  Spaces 

We  say  that  a  search  space  is  recursive  if  it  contains  a  recursive  inference 
I)ath  (as  defined  in  Sextion  1.3).  It  should  come  as  no  surprise  that  recursive 
collections  give  rise  to  recursive  sem’ch  spaces. 

Theorem  2.1  For  any  recursive  collection  of  facts  there  is  at  least  one  goal 
that  will  result  in  a  recursive  search  space. 

Proof  By  the  definition  of  a  recursive  collection^  there  is  some  common  set 
of  bindings  h  for  the  variables  in  each  of  the  facts  Fx  through  F^  such  that 
each  Li\ij  ~  and  |  il^,  —  Lui/,  From  the  goal  proposition  Lil^,  using  the 
rules  it  is  possible  to  regenerate  the  subgoal  Lx\i,.  This  process  can 

be  repeated  arbitrarily  many  times,  resulting  in  an  arbitrarily  long  inference 
path,  a 

As  an  exainpk*,  considcT  the  transitivity  rule  for  circuit  connections.  The 
search  space*  in  Figure  1-1  shows  that  the  goal  (Umn{A,z)  has  a  recursive 
space  since  each  subgoal  in  the  sequence 

{Conn{A,  z),Conn{A,  y),Conn{A,  i/),  Conn{Ay  j/''), . . .) 

is  an  instance  of  the  preceding  goal. 

Corollary  2.2  If  a  goal  proposition  g  results  in  a  recursive  search  space  for 
a  given  recursive  collection,  any  generalization  g^  of  the  goal  will  also  result 
in  a  recursive  search  space. 

By  a  generalization  of  a  proposition  f/,  we  mean  a  proposition  g*  such  that 
—  y  for  some  set  of  bindings  b.  For  example,  since  the  query  Conn{A,  z) 


^This  is  not  a  v<Ty  iiit<*rcsting  recursive  collection.  Most  recursive  collections  have  addi¬ 
tional  coiijiiiicts  ill  their  j)roiiiises. 


2.3  Recnrsivo  Inference 
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hits  a  rociirsivo  st'arch  apaco,  th<!  query  Conn[x,  z)  will  alao  have  a  rcctiraive 

s 

aeardi  space. 

It  is  natural  to  ask  whether  recursive  collections  are  the  only  kinds  of 
facts  that  can  lead  to  infinite  search  spaces.  Infinite  search  spaces  can  always 
occur  if  there  is  an  infinite  database,  but  barring  this  possibility,  the  answer 
appears  to  be  yes. 

Conjecture  2.3  If  an  infinite  path  exists  in  the  search  space  there  must  be 
a  recursive  collection  of  facts  involved  in  the  generation  of  that  path. 

In  fact,  we  believe  that  a  stronger  statement  holds. 

Conjecture  2.4  A  .set  of  n  axioms  that  is  not  a  recursive  collection  can 
generate  an  inference  path  of  at  most  length  (2”  —  2)a  +  1  where  a  is  the 
maximum  arity  (number  of  arguments)  of  all  relations  in  the  collection.^ 

L(iwis  [Lew75]  has  proven  a  weaker  theorem,  but  we  are  not  aware  of  any 
proof  of  these  conjectures. 

2.3  Recursive  Inference 

As  we  statcul  in  Section  1.3,  rectirsive  inference  occurs  when  an  inference 
procedure  follows  a  recursive  path  hi  a  rwursive  search  space.  By  this 
di^finition  a  recursive  search  space  is  a  necessary  condition  for  recursive  in- 
f(>r('nc<!,  but  it  is  not  a  sufKcient  condition.  Even  though  a  given  problem 
may  have  a  rc'cursive  search  sjiace,  rc'cursive  iiifi'rence  will  not  necessarily 
result.  Consider  the  riJonimlated  version  of  th('  transitivity  axiom  for  cir¬ 
cuit  connections  (S«:tiou  1.2.4).  Although  the  search  spiu:o  for  the  goal 
Conn{A,  z)  is  still  a  recnrsivo  sjiaco,  if  the  IConn  conjunct  is  always  solved 
first,  recursive  inference  will  never  result  for  this  goal. 

In  general,  whether  or  not  recursive  inference  occurs  depends  upon 

•  the  specific  chai’acteristics  of  the  recursive  collections  involved, 

•  the  search  strategy  employed  by  the  inference  procedure, 

'Wc  arrived  at  tlic  foriinila  (2"  -  2)rt  + 1  I>y  empirical  geiieralixation  of  a  wit  of  exiunpliv, 
begiuniug  with  the  cyclic  collection 

P{y,x)  Q[x,y) 

Q(A,x)  P(D,x) 

and  progressing  to  liighcr  arity,  more  rules  and  rules  involving  ftnictioual  exi)rc88ion8. 
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•  the  strategy  for  evaluating  einlx'dded  functional  expressions  (whether 
they  are  evaluated  or  tix^ated  syntactically), 

•  the  number  of  answers  desired  for  the  problem,  and 

•  the  iminber  of  answers  actually  available  for  the  i)roblem. 

If  non-recursive  subgoals  are  preferred  to  recursive  subgoals,  the  chances  of 
recursive  inference  will  be  less.  Likewis(},  if  non-recursiv('  clauses  arc  pre¬ 
ferred  to  recursive  clauses  in  conjunctive?  subgoals,  the  chances  of  recursive 
inference  will  be  less.  In  contrast,  recursive  inference  becomes  more  lik(?ly 
as  the  ratio  of  number  of  solutions  sought  to  number  of  solutions  available 
iiiCTe;usos.  Unfortunately,  there  is  no  simple  precise  characterization  of  when 
n'cursive  inf(Tence  will  or  will  not  o(‘cur.  Any  such  charact(Tization  would 
recpiire  a  classilication  of  all  tlu'  diirerent  possil)iliti<?s  for  ('ach  factor,  and  a 
nndti-dimensioiial  tabh?  to  consider  all  of  the  difh'rent  combinations. 

Since  some  of  the  factors  are  uncontrollable  (or  the  cure  is  worse  than 
th<'  disease),  the  best  that  we  can  say  is  that  when  a  recursive  collection  is 
pres(‘nt,  th<'re  is  the  potential  for  n'cursive  inference. 
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3  Repeating  Inference 

As  indicated  in  Section  1.3,  repeating  inference  is  when  the  sequence  of 
processed  goal  conjuncts  acttially  repeats.  In  other  words,  there  is  some  in¬ 
finite  subsequence  of  the  goal  conjuncts  processed,  such  that  each  successive 
conjunct  is  <ui  instance  of  its  predecessor.  Most  of  the  (ocainples  that  we 
considered  in  Sc'ction  1  were?  of  repeating  inference.  In  particular,  the  con¬ 
nectivity  (!xanij)le  had  this  characteristic,  since  a  goal  expression  of  the  form 
Conn[A,z)  is  gc'iierated  and  expanded  repeatedly  in  the  leftmost  branch  of 
the  AND/OR  search  tree. 

In  n'peating  inference,  a  portion  of  the  AND/OR  search  space  is  repeated 
over  and  over  ag;iin.  To  control  the  search  we  must  d(;t('rmine  the  levt'l  at 
which  the  rep('tition  can  be  cut  off.  The  search  space  b(>low  the  cutoff  point 
must  not  liold  any  new  answers. 

3.1  Finding  a  Single  Answer 

First  consid{>r  tin;  si>ccial  case  where  only  a  single  answer  is  needed  for  a 
query.  In  sucli  easels,  if  an  answer  cannot  be  found  without  exploring  a 
r('j)eating  portion  of  th('  si)ace,  no  answi'r  can  be  found  at  all.  As  a  rcsidt, 
tlu'  search  sj)ac('  can  be  j)niued  drastically. 

Theorem  3.1  If  only  n  sinyle  answer  is  needed  for  a  goal  g,  any  deseendant 
g'  that,  is  mi.  inslanre  of  g  can  be  discarded  (along  with  the  entire  subspaee 
descending  from  g' ).  Furthermore,  it  is  optimal  to  do  so  (i.e.  the  least 
expensive  way  of  finding  an  answer  does  not  involve  searching  the  subspaces 
descendant  from  any  of  the  (f). 

Some  notation  is  needed  in  order  to  demonstrate  this  result  mid  other  results 
to  follow.  Lt't  S[g)  ri'fcr  to  the  search  s])ac(’  beginning  with  the  goal  g  and 
containing  all  of  the  legal  dcscendmits  of  the  goal  g.  A  frontier  set  F  of 
a  search  space  S[g)  is  defined  to  be  a  set  of  goals  in  tlu;  space  such  that 
no  goal  in  the  frontiijr  set  is  a  descendant  of  any  other  goal  in  the  frontier 
s('t .  Intuitively,  a  frontier  s('t  is  sonu'  ])ossibly  jagg(*d,  partial  slice  through  a 
scwch  space;.  Lc't  Sp(g)  rejfer  to  that  jiortioii  of  the  space  not  including 
any  of  the  fronti(>r  goals  /  G  F  or  tlieir  dc'sce'iidmits  S{f).  In  oth(;r  words, 
the  ri'stricted  se'arch  space  Sj,'{g)  is  just  S(g)  with  all  of  th<'  frontier  brmichcs 
lu'uned  out.  Let  Ap{g)  re'fer  to  the  set  of  answers  to  the  goal  g  present  in 
the  restricted  sjiace  SF{g). 
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For  a  recursive  si)acc  lot  R^,{(j)  ref('r  to  the  frontier  set  consisting  of  the 
level  ix'petitions  of  the  goal  (j.  Using  this  notation  the  ahove  theoreni 
can  be  stated  more  precisely  as, 

If  only  a  single  answer  is  needed  for  the  goal  g,  the  optimal 
strategy  will  involve  a  search  in 

Proof  Suppose  that  the  space  Sji^^g){g)  contains  no  answers  to  g.  Since 
each  goalg'  G  Ri{g)  is  an  instance  of  g,  the  space  Sii^^g>){g')  does  not  contain 
any  answers  to  g'.  By  induction,  there  are  no  answers  to  any  of  the  repeating 
goals,  and  hence  there  are  no  answers  to  g.  Consequently,  restricting  the 
search  to  5n,(g)('/)  will  still  result  in  the  correct  answer  and  will  not  sacrifice 
optimality. 

Suppose,  on  the  other  hand,  that  there  is  an  answer  to  g  in  Sii,^g){g).  Let 
a'  be  the  easiest  answer  to  find  for  the  goal  g'  €  Ri{g)-  The  same  proof  will 
result  in  an  answer  a  to  the  goal  g.  Therefore  the  answer  a  will  be  easier 
to  find  for  g  than  the  answer  resulting  from  a' .  /Is  a  result,  restricting  the 
search  to  Sii^(g){g)  will  not  sacrifice  optimality.  □ 

There  is  a  useful  corollary  of  this  theorem. 

Corollary  3.2  Repeated  ground  queries  and  functional  queries  can  always 
be  pruned  from  a  search  space. 

Tliis  result  holds  beciuise  fiuictional  queries  never  have  more  than  one  jm- 
swer. 

Finally,  note  that  Tln'orein  3.1  does  not  mean  that  all  repetitions  can  be 
discarded,  only  those'  ftir  goals  that  reepiin'  only  one  solution,  (’onsuh'r  the 
hypothetical  search  space  in  Figure  3-1.  The  goal  g,  which  has  only  a  single 
solution,  generates  a  conjunctive  descenrhmt  h  A  j.  It  might  be  necessary 
to  sevarch  through  several  of  the  answers  to  the  conjtmct  h  in  order  to  find 
a  solution  to  the  conjunction.  Tims,  while  any  reoccurences  of  g  can  be 
discarded,  reoccurenccs  of  the  gofd  h  cannot  be. 

3.2  Finding  Multiple  Answers 

In  cases  whert?  more  llum  one  auswiu'  is  needed,  Theoreni  3.1  does  not  apply. 
Such  problems  arise  far  more  often  than  miglit  bo  expc'ctc'd.  Even  though 
only  a  single  answer  is  needed  for  a  problem,  some  of  its  subproblcms  may 
b(!  conjunctive,  as  in  tin*  example  abovi'.  Solving  a  conjunction  frequently 
requires  generating  more  than  one  solution  to  at  least  one  of  the  conjuncts. 
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Figure  3-1:  Search  space  for  a  single-solution  problem 


3.2.1  The  Theory 

If  inulliph'  answ(TS  are  needed,  in  ordc'r  to  ('liininate  a  portion  of  the  repeat¬ 
ing  !?i)ace  wo  must  show  that  that  portion  of  the  space  is  redundant  (i.e.  will 
not  produce'  any  novel  answers  to  the  original  problem).  What  makes  such 
a  proof  possible'  is  the  obse'rvatiem  that  if  a  search  of  one  or  more  levels  of 
re'i)e'titie)n  ele'epe'r  in  a  recursive  space  eloe's  not  ])ro(lue'o  any  new  answe^rs,  no 
amount  of  aelelitiemal  search  will  pre)eluce'  any  new  auswe'rs  to  the  e)riginal 
re'j)<vite)el  suj)e'rge)al.  Using  the  ne)tatie)n  inlTe)eluce<l  in  the  previems  sextion, 
we  can  stiite  l;his  more  precisely. 

Theorem  3.3  Let  F  he.  the  frontier  set  RnUl)  consisting  of  level  in- 
sUinces  of  the  goal  g.  Let  F'  he  <i  frontier  .*)(,’/  consisting  of  repenting  descen¬ 
dants  of  goals  in  the  .net  F.  If  Ai'i{g)  =  Ai,'{g),  all  of  the  frontier  suhspaces 
S{r)  for  r  e  F  are  redundant.^ 


Proof  The  proof  is  hy  induction  on  the  level  of  repetition  in  the  search 
space.  First  we  prove  the  theorem  for  the  case  where  F'  =  iE„  |.i(3).  ff 
he  a  first  level  repeating  descendant  of  g  and  let  h  be  the  set  of  bindings  such 
that  if  =  g\i.  Let  r  be  the  subset  of  Rn(g)  that  are  descendants  of  g'  as  shown 
in  Figure  3-2.  Thus  r  =  .  Let  r'  be  the  set  i?i(r)  =  /{,,((/')  (all  first 
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Hus  thcewi'iu  reJics  on  the'  luexuiuptioii  e)f  ce>iii])I<’lc  iiietoxiiig  in  the  problem  solver’s 
<ljil!il):i.se.  Ill  oi  lier  words,  llie  sy.slcin  Jiiiisl  be  iible  lo  liiid  any  fuel,  in  llie  dutubuse  lliut 
inulche's  u  goal.  Willioul,  ceimplele  iiielexiiig,  answers  could  be  foniiel  lo  lui  iiisUiicc 
eif  <i  goal  when  lliey  cenild  iiol  be*  found  for  Hie  original  geial.  A  we'ake'r  version  of  the 
tlMHwem  still  holds  if  e'oniph'te'  inelexing  of  the  problem  solver’s  elalabiwe  is  neit  iuesumeel. 
Ill  this  case,  the  frontier  set  F  must  ceiiitaiii  rejie-titions  iiiste'iwl  of  instances  of  the  goal 
g.  Essentially,  this  means  that  search  must  be'  a  few  re'cnrsioii  levels  dee'per  until  a 
spee  ialixalion  of  the'  initial  geial  is  found  for  which  F  will  contain  pure  repetitions. 
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level  repeating  descendants  of  r)  and  let  r"  be  the  set  R2{r)  =  12n  il(!!/0 
second  level  repeating  descendants  of  r). 

The  space  Sr'  {g')  is  an  instance  of  a  portion  of  the  space  Sp  {g)  ■  In  fact, 

=  {a  :  a  U  6  €  Ai!'{g)}  . 

Likewise  the  space  Sr"{g')  is  an  instance  of  a  portion  of  the  space  Sp>{g)  so 

Ari>{g')  =  {a  :  aU  6  e  . 

Since  Ap{g)  =  Ap'ig),  it  follovis  that  Ar'ig')  —  Arii{<f). 

Let  4>gf  he  the  function  from  answers  to  a  descendant  </'  €  Ri{g)  to  an¬ 
swers  to  the  .supergoal  g.  In  other  words,  a  =  (f)gt(a')  means  that  if  a'  is  an 
answer  to  g' ,  a  will  be  an  answer  to  g.  Then, 

A(g)  =  Agi{g)  U  {a  :  a  =  A  a'  E  A[g'))  . 

Now  consider  the  frontier  F"  -■  Rnu{g)-  Using  the  two  results  above, 

Ap"{g)  =  All^(^g'j{g)  U  [J  {a  ;  a  =  (f)gi{a')  A  a  €  Ar>i(g  )} 

g'elti  (g) 

=  U  {rt:a=  Aa'e 

g'Qltiig) 

=  Ap'{g) . 

By  induction  Aj,(*){f/)  =  Ap{g)  for  all  k.  Thus,  A(g)  =  Ap{g),  which  means 
that  the  repeating  descendants  in  F  arc  redundant. 

Finally,  for  any  .set  F'  .satisfying  the  requirements  of  the  theorem, 
^n,.^x(g)i*.l)  ^  ««  Ap>{g)  =  Ap{g)  implies  that  ,(„)(</)  -  Ap{g). 

Since  the  theorem  holds  for  F'  =  /d„  1 1(</)  it  holds  for  arbitrary  F' .  □ 

Corollary  3.4  The  depth  of  repetition  in  a  search  space  can  be  limited  to 
one  less  than  the  total  number  of  answers  de, sired  for  the  problem. 

Theorem  3.1  is  a  special  ease  of  this  corollary. 

Example:  Consider  the  connectivity  axiom  for  circuits, 

Conn(x,y)  A  Conn{y,z)  =>•  Conn{x,z)  . 

As  before,  suppose  that  the  problem  is  to  ihul  all  points  in  a  circuit  connected 
to  a  given  point  A, 


Hud  all  z:  Conn{A,  z) , 
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Conn{A,  z) 


Conn{A,  y)  Conn  {y,  z) 


Conn{A,y')  Conn[y\y)  Conn{y,w)  Conn{w,z) 


Conn{A,y")  Conn{y",y')  Conn{y,w')  Conn{w',w) 

Figure  3-3:  A  portion  of  the  backward  search  space  for  the  goal  Conn{A,  z) 

An  initial  portion  of  the  backward  AND/OR  search  space  for  this  problem 
is  reprodnc('d  in  Figure  3-3.  If  there  arc  no  miswers  in  the  system’s  database 
for  Conn{A,z),  there  are  ho  answers  at  all.  In  this  case  the  frontier  sets 
F  =  {^Conn[A, zY}  mid  F'  =  {“Con7'i(A,i/)”}  satisfy  the  conditions  of 
Theorem  3.3.  Sf{<j)  is  tlic  null  space  and  Sp'ig)  is  the  space  consisting  of 
only  the  goid  g  —  “Conn(A,  ^)”.  Since  there  are  no  answt'rs  in  the  database 
for  tlu'  goal  g,  AF{g)  =  ’/(</)  =  0.  As  a  residt,  Theorem  3.3  states  that 

no  si'arch  is  neci'ssary  for  the  problem. 

If,  iiistc:ad,  the  database  contains  the  fact  Conn{A,  D),  but  no  facts 
about  the  coniu'ctions  to  IJ,  the  sets 

F  =  {“Conn{A,yY} 

and 

F' =  Y'Conn{A,y'Y} 

satisfy  the  theorem.  In  this  case,  and  5f<{gr)  both  contain  the  sin¬ 

gle  answer  z  =  D.  As  a  result,  only  database  answers  to  the  initial  goal 
Conn{A,  z)  need  be  located  in  this  c.ase. 

li'inally,  su])])o.se  that  the  datab.ise  contains  the  facts  Conn{A,  D)  and 
Conn{D,C)  but  no  other  connections  to  A,  D  or  C.  For  this  case,  the  cutoflf 
frontiers  contain  two  terms  since  the  right  hand  branch  of  the  conjunction 
also  contributes  a  recursive  branch  for  the  binding  z  =  D. 

F  =  Y^.Corm[A,y'Y ,  “Conn(I?, •«;)”} 
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F'  =  {‘Vonn(A,y"y’,‘‘Conn(B,wy} 

For  both  of  these  frontiers,  the  answer  sot  will  consist  of  z  =  B  and  z  —  C. 

Optimality  Althoiigh  Theorem  3.3  tells  ns  some  conditions  under  which 
a  portion  of  the  search  space  is.  redundant,  it  docs  not  tell  us  that  j)runing 
the  redundant  portion  of  the  space  is  noci'ssarily  optimal.  In  some  cases  it 
can  be  advantageous  to  search  part  of  the  redundant  portion  of  the  space. 
As  .an  example,  consider  the  connectivity  example  of  the  previous  section, 
where  the  available  facts  were  Conn{A,  B)  and  Conn(B,C).  Suppose  that 
we  also  have  the  (non-recursive)  collection  of  facts 

H{x,  y)  =>  C(mn{x,  y) 

G(x,y)  =>  H{x,y) 

F(x,y)  =»  G{x,y) 

B{x,y)  =>  F{x,y) 

together  with  the  fa<‘ts  E{A,  B)  and  E{A,  C).  In  this  case,  we  could  find  all 
the  answers  to  the  query  Conn(A,z)  by  exploring  this  noii-rccursive  path. 
Theorem  3.3,  theniforc,  allows  us  to  conclude  that  the  go<d  Conn{A,y)  is 
redundant..  However,  the  non-reciirsive  way  of  finding  the  answer  ^  =  C  is 
long('r  and  more  costly  than  finding  the  sanu?  answer  by  exploring  a  level 
dwjx'r  in  tlu^  r('i>(Vit.ing  space.  As  a  M'sult,  pruning  the  subgoal  Conn(A,  z) 
is  non-optimal  for  this  case. 

In  the  case  wlnaa;  all  of  Urn  .solutions  are  needt'd  to  a  problem,  we  can 
.show  that  i)riming  the  redundant  portion  will  be  optimal. 

Theorem  3.5  For  recursive  problems  where  all  of  the  solutions  are  sought, 
if  there  exists  a  frontier  F  that  obeys  the  conditions  of  Theorem  S.3  the 
optimal  strategy  will  involve  searching  only  Sp{g). 

Proof  In  order  to  find  all  answers  in  a  space,  all  portions  that  may  con¬ 
tain  novel  answers  must  be  searched.  Assuming  that  we  do  not  know  which 
portions  of  Spir)  are  redundant  with  S{r)  for  each  r  €  F  then,  Splg)  must 
he  searched  in  any  case.  If  Sp(g)  must  he  .searched,  each  of  the  S{r)  contain 
only  redundant  answers,  so  there  is  no  advantage  to  searching  any  of  them. 
As  a  result,  the  optimal  strategy  will  be  a  search  over  only  Sp[g).  □ 

As  we  demonstrated  in  the  example  above?,  this  result  docs  not  hold  for 
prt)blems  where  some’  sju'cllic  numlx’r  of  .sedutions  is  sought. 
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3.2.2  Repetition  Cutoff  Algorithms^ 

Ill  order  to  make  use  of  Theorem  3.3  we  need  a  mechanism  for  finding  the 
repetition  level  that  satisfies  the  conditions  of  the  theorem.  Finding  such 
a  frontier  set  requires  preserving  the  answers  to  any  goal  with  repeating 
descendants. 

Algorithm  3.6 

1.  If  a  goal  Qi  is  an  instance  of  one  of  its  supcrgoals  g,  the  goal  gi  is  sus¬ 
pended  until  cill  other  alternatives  for  solving  g  have  been  exhausted. 

2.  If  any  new  answers  are  found  to  the  goal  3,  all  repeated  instances  g^ 
of  g  are  enabled  for  another  l(‘vel  of  expansion.  If  not,  the  infei*cnce  is 
terminated. 

A  flowchart  of  a  problem  solver  inc^orporating  this  procedure  appears  in  Fig¬ 
ure  3-4.  One  major  effichncy  improvement  can  be  made  on  this  procedure. 
The  answers  produced  by  exj)an(ling  tlie  scotcIi  space  an  additional  level 
of  repetition  will  be  a  subset  of  those  produced  in  tlu'  first  level  since  each 
repeated  descendant  gi  is  an  instance  of  the  goal  g.  Therefore,  it  is  not 
necessary  to  rejiroduce  the  space  at  each  level.  It  is  suf[ici('nt  to  caclu'  all  of 
the  answers  to  the  supergoal  and  use  them  as  the  answers  to  any  rcqx'atcd 
descendants.  Thus,  a  more  efficient  ])r()cedure  would  be 

Algorithm  3.7 

1.  Each  time  a  solution  is  found  to  a  query  (or  sulxiuery)  the  solution  is 
cached. 

2.  When  a  repeated  descendant  is  encountered,  only  instances  found  in 
the  system’s  database  (including  cached  answers)  are  used  as  solutions 
to  th('  rei)eated  desceiidcant.  No  additional  inference  is  performed  on 
this  repeated  descendant. 

3.  The  solution  of  a  n'peated  descendant  is  not  complete  until  no  ad¬ 
ditional  solutions  caji  Ix'  found  to  the  goal  that  it  is  a  repeat  of.  In 
other  words,  new  answers  to  a  goal  must  continually  be  plugged  into 
all  rejx^ated  descendants  until  quiescence  occurs  and  no  new  answers 
appear. 

^  Those  ah'orithiiis  were  first  discovered  by  Black  [BlaC8]  and  were  later  rediscovered  by 
McKay  and  Shapiro  [MS81]  mi<l  by  the  authors. 
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Figure  3-4:  Backward  iuferonce  i)rocc(lure  with  repetition  control. 
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Figure  3-5:  An  idealized  AND/OR  tree  coiitaiiiiiig  repetition 


As  an  illustration  of  this  method,  consider  the  sejirch  tree  shown  in 
Figure  3-5.  This  tree  is  a  snapshot  of  the  goal  stack  for  the  inforonce  engine 
at  some  point  in  the  computation.  There  are  two  repetitious  of  the  original 
goal  expression  g,  both  of  which  are  suspended  awaiting  answers  to  g.  If  the 
Miswcr  a  is  found  to  g,  this  answer  is  cached  and  conswiuently  plugged  in 
as  an  answer  for  g*  mid  g'' .  If  these  branches  generate  additional  answers  oi* 
and  a"  to  g,  then  these  answers,  in  turn,  fu'e  cached  and  must  be  tried  in 
the  two  repeated  descendants.  When  no  new  miswers  to  g  can  be  produced 
the  process  is  complete. 

Example:  Circuit  Connections  ('ousider  the  coiUK'ctivity  example  of 
the  Section  3.2.1  wlu'ie  tlie  goal  is  to  lind  all  points  in  a  circuit  coniKH:ted 
to  a  given  ptiint  A  and  the  databiise  contains  the  facts  0<>nn(A,  D)  and 
Conn(B,C).  First  the  miswer  z  :  D  is  found.  Tlu>  transitivity  nile  is 
then  applied  to  the  initial  goal  yi<-lding  C(mn{A,y)  A  Conn{y,  z).  Since  the 
clause  Conn{A,y)  is  an  instance  of  the  inithU  goal,  (7onn(A, «),  no  infer¬ 
ence  is  jierformed  on  this  clause.  However,  since  there  is  already  a  catdied 
solution  to  the  original  goal  Conn{A,z)  the  solution  y  :  D  is  found  for 
the  repeated  descendant.  Substituting  this  binding  into  the  other  conjunct 
yields  the  subgoal  Conn(Ii,z).  The  answer  z  :  C  is  found  in  the  .system’s 
dat.al)ase  and  is  l,lK'r(dore  cached  as  a  solution  to  tln^  original  goal.  The  de¬ 
scendant  C(mn(D,z)  is  tlnm  expamh'd  using  the  transitivity  rule,  yielding 
the  conjunction  Conn{D,y')  AConn{y' , z).  As  with  the  first  expansion,  the 
clause  C(mn{D,y')  is  an  instance  of  the  subgojJ  Conn{D,z)  so  no  infer¬ 
ence  is  performed  on  the  repeated  clause  Conn{D,y').  As  before  there  is 
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Conn{A,  z) 


Conn{A,  y)  Conn  {y,  z) 


Conn{D,y')  Conn[y\z)  Conn{C,y'")  Conn{y"\z) 

\y'-c 


Conn(C,  z) 


Conn{C,y")  Conn{y'\z) 

Figure  3-6:  Search  for  the  query  Conn{A^  z) 
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jxlro.idy  a  aohitioii,  y'  :  C,  in  the  system’s  database  to  the  repeated  clause. 
This  solution  is  substituted  into  the  other  conjunct  yielding  the  subgoal 
Conn{C,z).  There  iu'e  no  solutions  to  this  clause  in  the  system’s  database. 
The  expansion  to  Conn{C^y")  A  C(mn{y",z)  again  contains  the  repeating 
subgoal  Conn{C,y"),  so  no  further  iiih'reuce  is  performed  <md  no  answers 
are  found  to  ConTi{C,z).  This  leaves  no  further  alternatives  for  the  super- 
gocil  Conn{D,z).  However,  this  subgoal  did  generate  an  additional  answer 
(z  :  C)  to  the  inithil  goal  Conn(A,  z),  so  the  cached  fact  must  be  used  in  the 
first  repeating  descendant  Conn{A,y').  Substituting  the  binding  y'  :  C  into 
the  other  conjunct  yiedds  the  subgoal  Conn[C,  z).  As  before,  this  subgoal 
yields  no  solutions,  and  the  inference  process  terminates. 


Example:  Ancestry  As  a  second  example,  consider  the  problem  of  find¬ 
ing  all  albinos,  given  the  rule 

Alhmo(x)  A  Parentftlz)  =  {a:,2/}  AAlbino{y)  =>  Albino{z) 


Assume  that  our  database  contains  the  facts: 

ParentH[ADCD)  =  {AD, CD) 

Parcnts(AD)  —  {A,D} 

ParcntH(GD)  ={C,D} 

AUnno{A) 

AUnno\D) 

Albino{C) 

Albino[D) 

Beginning  with  the  conjunct  Mbino[z)  the  system  would  first  discover  the 
four  answers  in  its  datab;ise.  It  would  then  apply  the  recursive  rule  resulting 
in  the  conjunction  Alhinn(x)  A  Parcnli>[z)  =  {'X,y}  A  Albino{y).  The  first 
of  tlu'se  conjuiicts  is  idcuiticcU  to  its  p.'U’ent  so  the  algorilhiu  would  halt 
further  inference  on  this  branch.  How('ver,  since  there  ai'c  already  four 
cached  solutions  to  the  original  problem,  these  are  substituted  in  <i8  sohitions 
to  the  repeated  descendant.  Wc  are  left  with  the  conjunction  Parents(z)  = 
{x,y}  A  Albino{y)  for  the  cases  ol  x  =  A,  x  =  D,  x  =  C  and  x  =  D.  For 


3.2  Finding  Multiple  Answers 


29 


Albino(z) 


Albtno(x)  Parents(z)  =  {x,p}  Albmo(y) 

x=  A  z=  AD  y=  D 

B  AB  A 

C  CD  D 

D  CD  C 

AB  ADCD  CD 

CD  ADCD  AD 


Figure  3-7:  Search  space  for  the  query  Albino[z). 


these  (lifFerent  bindings,  the  parents  conjunct  yields  values  for  y  and  z: 

X  y  z 

A  D  AD 
B  A  AD 
C  D  CD 
D  C  CD 

For  <'a<  h  of  tlu'se  solutions  for  y,  tlie  linal  conjunct  AUnno[y)  is  verified 
by  referi'iicc'  to  tlie  database.  Thus,  the  ausw<TS  AD  and  CD  ar<*  pro<luced 
and  cached  for  the  original  (juery.  These,  iu  turn,  are  substituted  into  the 
rej)eat('d  descendant,  again  yhdding  the  conjunction  Parcnts(z)  =  {x,y}  A 
Albino{y)  for  tlu'  cases  x  =  AD  and  x  ~  CD.  The  parents  conjuncts  yield 
new  values  for  y  and  z: 


X  y  z 
AD  CD  ADCD 
CD  AD  ADCD 

Again  the  conjuncts  AUnno{CD)  and  Albinn(AD)  are  vc'rified  by  reference 
to  the  database  so  the  answer  ADCD  is  produc('d  and  cached  for  the  original 
(jiiery. 

Finally,  substitution  of  ADCD  into  the  rci)cated  descendant  yields  no 
additional  answers  (since  ADCD  has  no  progeny)  and  the  search  terminates. 
A  sk('tch  of  this  search  space  appears  in  Figure  3-7. 
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Soundness,  Completeness  and  Optimality 

Since  Algorithms  3,G  and  3.7  «ir<'  incndy  ways  of  finding  frontier  sets  that 
satisfy  Theorem  3.3,  they  do  not  adversely  affect  the  logiccd  soundness  or 
completeness  of  an  inference  procedure.  Although  use  of  these  algorithms 
will  result  in  a  drastic  reduction  of  th<'  size  of  repeating  search  si)aces,  their 
use  does  not  guarantee  termination  of  search.  This  is  because  the  restricted 
search  space  Sn{g)  can  still  be  infinite.  Theorem  3.3  and  the  algorithms  do 
not  det('ct  or  eliminate  divergent  inference  paths.  As  a  result,  an  inference 
procedure  making  use  of  the  cutoff  algorithms  might  still  encounter  a  diver¬ 
gent  path  and  might  therefore  iiovct  terminate  or  find  all  of  the  answers  in 
the  space. 

However,  barruig  divergent  paths,  inference  procedures  based  on  Algo¬ 
rithms  3.6  and  3.7  are  gnarante(?d  to  terminate,  mid  any  solution  in  the 
s(^arch  space  will  be  found.  If  the  subgo<il  generator  is  logically  complete, 
such  an  inference  procedure  will  also  be  logically  complete. 

The  algorithms  limit  search  to  one  recursion  level  beyond  the  minimal 
level  that  satisfies  the  conditions  of  Theorem  3.3.  In  Section  3.2.1  we  pointed 
out  that  cutting  off  redumhuit  recursive  paths  at  the  earliest  possible  level 
may  not  be  optimal.  This  observation  therefore  extends  to  the  algorithms 
as  well. 

3*3  Special  Types  of  Repetition 

The  theorems  of  the  previous  section  an'  general,  but  weak.  There  are 
special  cases  of  repeating  infinence  wlu're  stronger  results  are  possible.  For 
example,  in  Section  3.1  we  develoj)ed  a  much  stronger'  result  for  the  case 
where  only  a  single  answ('r  was  nec'dc'd.  There  are  two  other  sjxHual  cases 
that  merit  particular  attention,  dcsceiuhmt  subsumj)tion,  and  transitivity. 
Both  of  these  cases  rely  on  genercxl  goal  subsumption  for  their  power.  We 
say  that  a  goal  set  g  subsumes  another  goal  set  if  there  is  a  set  of  bindings 
b  such  that  g\b  ^  g*-  If  only  a  single  answer  is  needed  for  a  problem  any  goal 
set  subsumed  by  anotlier  goal  set  g  will  b('  redundant  with  that  descendant 
[NilSO].  The  situation  is  somewhat  more  complicated  when  more  than  one 
answer  is  needed. 

Theorem  3.8  Let  g^  and  g**  he  descendants  of  g  and  let  b*  and  6^'  be  the 
binding  sets  that  relate  solutions  to  g^  and  g^‘  to  solutions  to  g  (i,e.  g^  =>  g\i,f 
and  r/"  g\bff  Suppose  that  g^  subsumes  g''  with  the  bindings  c.  If  the 
bindings  for  the  output  variables  in  PUc  are  a  subset  of  the  bindings  6'^,  g'' 
is  redundant  with  g'. 
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Q{x) 


Figure  3-8:  Subsumption  example 

Proof  Let  a"  be  a  solution  found  to  g".  Then  a"  U  6”  is  n  solution  to  g 
that  will  he  found  by  exploring  g" .  We  mu.st  show  that  the  same  solution  (or 
a  generalization  of  it)  can  he  found  by  exploring  g'.  Since  ^\c  C  g"  we  know 
that  there  is  some  solution  a'  C  a”  U  c  that  will  be  found  for  g'  (assuming 
complete  database  indexing).  Thus,  a'  U  b'  will  also  be  a  solution  to  g.  But 
since  a'  C  a"  U  c  and  b'  U  c  C  b"  we  have  a'  U  b'  C  a”  U  c  U  6*  C  a"  U  6”. 
So  the  solution  a'  U  b'  found  by  the  descendant  g'  is  a  generalization  of  the 
solution  a"  Ub"  found  by  the  descendant  g" .  g"  is  therefore  redundant  with 

g'.  □ 

As  an  example,  considcu"  the  simple  search  space  of  Figure  3-8  generated 
from  the  goal  Q{x)  using  the  rules 

Rl  :  P(a:)  =>  Q{x) 

R2  ;  r{A)  =:=>  Q{A) 

R3  :  r{A)  ==>  Q(D) 

R4  :  P{A)  ==^  Q{x)  . 

The  subgoal  P{x)  subsumes  the  three  subgoals  P{A)  with  the  bindings 
c  =  {x  :  A},  but  not  all  of  these  subgoJils  are  redundant  with  P{x).  The 
leftmost  P{A)  in  Figure  3-8  is  reduiidiuit  because  its  binding  set  {x  :  A} 
is  identical  to  c.  Howc'ver,  the  second  P(A)  has  the  binding  sot  {x  :  D}, 
which  docs  not  contain  x  :  A.  Therefore,  this  subgoal  is  not  redundant  with 
the  subgf>al  P(x),  unless  x  is  not  an  output  vari;d)le.  The  third  instatice  of 
P{A)  is  also  not  redundant  with  the  sid)goal  7*(x)  (assuming  x  is  an  output 
vari.able),  since'  it  has  an  empty  binding  set.  Finally,  it  is  worth  noting 
that  the  first  juid  second  instances  of  P{A)  are  redundant  with  the  third 
instance  of  P{A).  For  these  cases  c  is  empty  and  therefore,  is  contained  in 
any  binding  sot. 
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Descendant  Subsumption  Wo  can  ai)i)ly  Theorem  3.8  to  eases  of  re¬ 
peating  inference.  In  this  case,  is  a  descendant  of  g\  and  the  root  goal  g 
can  be  taken  to  be  g'.  Thus,  the  binding  list  &'  is  empty. 

Corollary  3.9  Let  g*  be  a  repeating  descendant  of  g  and  let  b  be  the  set  of 
bindings  that  relate  solutions  to  g*  to  ^solutions  to  g  (g*  =>  g\h)>  Let  c  be  the 
set  of  bindings  such  that  g^  =  g\c.  If  the  bindings  for  the  07ttput  variables  in 
c  are  contained  in  b,  the  goal  g^  is  redundant  with  the  goal  g.  Furthermore, 
the  optimal  strategy  does  not  involve  gf^ 

As  an  example,  consider  the  simple  search  space  of  Figure  3-9  generated 
from  the  goal  P(a;)  and  tlie  rules 

Rl:  P{A)^P{A) 

722:  i’{A)=>P(7?) 

723  :  P{A)  =>  P(x)  . 

The  throe  subgoals  P(A)  are  subsumed  by  the  root  goal  P(x)  with  the 


P(x) 


Figure  3-9:  Repetition  subsumption  example 

binding  set  c  —  {x  :  A).  The  first  subgoal  has  bindings  b  ==  {x  :  A)  and  can 
thcTcforc  be  <diiriinatcd.  Tlie  se(*ond  lias  the  set  of  bindings  b  =  (x  :  7?}, 
which  docs  not  contain  c.  Therefore,  it  cannot  be  eliminated  if  x  is  an 
output  variable.  Likewise,  the  third  subgoal  cannot  bo  eliminated  since  its 
binding  set  b  is  empty. 

Tlie  most  common  cases  of  d(\scendant  subsumption  are  wlu'ii  a  descen¬ 
dant  is  id(mtica]  to  an  ancestor  in  every  respect,  including  variabl(?s.  For  this 
case,  the  set  c  is  empty  and  the  descendant  can  be  eliminated.  These  sit¬ 
uations  arise  from  if-and-only-if  niles  expressing  definitions  and  from  rules 
(expressing  prop('rtics  like  symnu'try,  associativity,  and  coinmutivity.  For 
example,  in  a  circuit  analysis  system  W('  might  need  the  information  that 
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Conn{A^  z) 


Conn{z^A) 


Conn{A,  z) 


Figure'  3-10:  Sevirch  path  for  a  syimnetry  rule. 

electrical  connections  are  symmetric. 

Conn{x,y)  =>  Conn{yyX) 

Suppose  wo  were  to  apply  this  rule  for  the  in'oblem  of  fincliiig  all  the  points 
in  a  circuit  conn(H:ted  to  a  giveui  point  A, 

find  fill  z:  Conn(Ay  z) 

We  first  get  the  subgoal  Conn[2yA),  Applying  the  nih^  to  this  subgoal  gives 
the  siibgoal  Conn{A,z)  again,  as  shown  iai  Figure  3-10.  This  is  silly,  since  it 
only  h'ads  us  back  to  wh<?re  we  started.  We  can  always  prune  such  repc'tition 
according  to  the  subsaimi)tion  theorem. 

Transitivity  TIk^  subsumj>tion  tlieorem  also  has  a  direct  application  to 
rej)eating  inference  resulting  from  transitivity  rules.  Consider  the  connec¬ 
tivity  cxami)le  us(h1  in  the  previous  sections,  with  the  query  Conn[Ay  z)  and 
a  database  containing  the  facts 

Conn[AyB) 

Conn[DyC) 

Conn\CyD). 

Figure  3-11  shows  the  portion  of  the  space  that  would  be  generated  for 
this  problem  using  Algorithm  3.7.  First,  the  answer  ;2r  =  il  is  found  in  the 
database.  Then,  the  conjunctive  subgoal  Conn{Ayy) /\Conn{yyZ)  is  gen¬ 
erated.  The  first  of  these  conjuncts  is  repeated,  so  we  jdug  in  the  answer 
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Conn{A,  z) 


Conn(y,  z) 

y.C 


Conn{A,  y) 

y  :  ^  ^ 


Conn(D,z) 


C(mn(D,u)  Conn(u,z) 

y:C^  y  :  D 


Conn{C,  z)  Conn(D,  z) 


Conn{C,v)  Conn{v,z)  Conn(D,w)  Conn(w,z) 
I 

Iv.D 


I 

Conn(D,  z) 


Conn{D,w)  Conn{w,z) 


Conn{C,  z)  Conn(D,  z) 


Conn{C,v)  Conn{v,z)  Conn{D,w)  Conn{w,z) 
I 

!«:!) 

I 


Conn{D,  z) 


Conn(D,w)  Conn[w,z) 


Figure  3-11:  Search  space  for  the  query  Conn{A,z). 
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B  that  has  already  boon  foniul  Continuing  on  the  remaining  conjunct 
Conn{D^z)  we  find  one  answer  in  the  database,  z  ^  and  use  the  tran¬ 
sitivity  rule  to  generate  the  subgoal  Conn{D^u)  A  Conn[u.^z).  The  first  of 
these  conjuncts  is  a  repeat  of  its  parent  so  we  again  plug  in  the  solution  al¬ 
ready  found,  u  —  C.  The  remaining  conjunct  becomes  Conn{C^z).  Again, 
there  is  a  single  answer  in  the  datcibase,  z  —  D.  We  apply  the  transitivity 
rule  one  more  time  yielding  the  conjunction  Conn{C^v)  A  Conn{v^z).  The 
first  of  these  is  again  a  repeat  of  its  parent  and  we  plug  in  the  available 
solution,  V  =  D.  The  remaining  conjunct,  Conn{D,z)^  yields  no  solutions, 
so  we  begin  to  unwind.  Note  that  wo  have  already  found  all  of  the  solu¬ 
tions  to  the  problem,  z  —  D,C  and  D,  yet  we  have  not  substitTited  the 
newly  gcueraU'd  answers  into  th('  two  remaining  repeating  descendants.  Ac¬ 
cording  to  the  algorithm,  we  must  substitute  u  =  D  into  the  conjunction 
Conn[B^u)  A  Conn{u^z).  Following  this,  we  must  substitute  the  answers 
y  =  C  and  y  ^  D  into  the  first  subgoal  Conn{A,y)  A  Conn{y^z).  Each  of 
these  substitutions  caiisos  more  redundant  inference.  In  eff(H‘t  the  procedure 
produces  each  of  the  answers  twice.  A  similar  situation  occurs  with  the  dual 
query  Conn(x,  D)  (assuming  the  conjuncts  are  processinl  in  a  reasonable  or¬ 
der)  and  with  the  general  query,  Conn{x^z). 

Much  of  the  duplication  can  be  eliminated  by  recognizing  and  pruning 
subsumed  goals.  For  example,  the  two  instances  of  the  goal  Conn((7, 2r) 
are  mutually  redundant  according  to  the  subsumption  theorem.  Likewise, 
the  four  instances  of  th('  goal  Conn(D,z)  are  mutually  redundant.  If  all 
but  one  of  each  are  ('liminat<'d  the  remaining  s<'arch  space  does  not  contain 
any  redundant  i)ortions.  Using  the  subsumj)tion  theorem,  together  with 
Algorithm  3.7  therc'fon'  solv('s  the  ]>robl('m.  Uow('ver,  the  two  results  can 
be  combiiKMl  into  a  more  succinct  nuluction  theorem. 

Theorem  3,10  Let  g*  A  be  the  conjunctive  suhgoal  produced  by  applying 
a  transitivity  rule 

R{x,  y)  A  R{y,  z)  R{xy  z) 

to  the  goal  g,  as  illustrated  in  Figure  S-12.  Let  h/  and  h”  be  the  conjunctive 
suhgoals  produced  by  the  application  of  the  transitivity  rule  to  the  conjuncts 
g*  and  g^*  respectively.  TheUy  Id  and  Id*  arc  niutually  redundant.  In  other 
words,  S(g)  Sfa{g)  =  6V(i/). 


Proof  For  all  possible  g  that  match  R{x,z),  the  conjunction  g*  A  Id*  sub¬ 
sumes  Id  /\g**  and  vice  versa.  For  example,  if  g  —  ''R[x,z)'\  g*  —  ‘^R{x,y)^, 
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9 


h!  /i" 


Figure  3-12:  Transitivity  search  space. 

(f  =  =  ^‘R{x,v)  /\  R{v^y)^^  and  =  ^R{y^7v)  AR{w^z)^\  then 

R{x^y)AR{y,w)AR{w,z)  subsumes  R{x^v)  AR{v^y)  AR{y^  z)  and  vice  versa 
for  any  subset  of  {x^z}  as  output  variables.  The  theorem  therefore  follows 
immediately  from  the  subsumption  theorem,  □ 

This  result  is  easily  iiiipleinentc'd.  When  a  transitivity  rule  is  applied 
to  a  goal,  the  rule  should  not  bo  applied  to  one  of  the  two  conjunctive 
subgoals  gc'iK'rated.  For  tlie  connectivity  exainple  the  two  possibilities  arc 
sliown  in  Figures  3-13  and  3-14.  If  the  transitivity  rule  is  not  reapplied 
to  left-hand  branches  the  result  is  a  sinijde,  but  lopsided  search  space.  If  it 
is  not  reappli('d  to  th('  right  hand  brancli,  n'peating  inference  occurs  in  the 
left-liand  branch,  and  the  inc'thods  of  Section  3.2  must  be  applied.  Using 
Algorithm  3.7,  inference  on  tlu^  left-hand  branch  would  stop  after  one  level. 
All  answers  are  gc'iuTated  merely  by  caching  solutions  and  substituting  them 
into  the  left  branch. 
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Conn{A,  z) 


Conn(A,y)  Conn{y,z) 

I 

'y:C 

I 


Conn{D,z) 


Conn[D.  u)  Conn{u,  z) 


^u:C 

I 

Conn{C,z) 


Cann{C,v)  Conn{v,z) 

I 

lu:I> 

I 


C(mn{D,  z) 


Conri{D,w)  Conn{v),z) 

Figure  3-13:  Lcft-prmiod  search  space  for  the  goal  Conn(A,z) 


Conn{A,  z) 


Conn{A,y)  Conn{y,z) 

y=  D  z=  C 
C  D 
D 

Figure  3-14:  Right-pruned  socirch  s[)nce  for  the  goal  Conn(A,z). 
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Integer  (2. 5) 


2.5  =  a:  +  1  Integer(1.5} 


1.5  =  a:  +  1  Integer  [Ft) 


.5  =  X  +  1  Int€ger{—.5) 

Figure  4-1:  Search  space  for  the  query  Integer [2. h).  The  first  conjunct  has 
been  evaluated  for  each  subgoal. 


4  Divergent  Inference 

The  most  troublesome  form  of  inference  loops  are  those  that  do  not  repeat. 
Consider  again  the  simple  rule  describing  the  integers: 

3/  =  X  -1- 1  A  Integer{x)  Integer{y)  (4  -  1) 

A  query  such  as  Integer  {2  g(*iKTates  aii  iuliiiite  sequence'  of  sid)goals  like 
that  shown  in  Figure'  4-1.  If  we  we're  te)  list  the  soeiue'iicc  e»f  gewd  e  emjuucts 
reelue-e'd  at  e'ach  si.e'p  in  the?  infe'rence'  pre)e:ess,  ne)  spe'eifie-  cemjunct  we)uld 
appear  mene'  than  eme-e?  in  this  se^epte'iice.  There  is  an  iiilinite  number  of 
Integer  conjeuicts  in  this  se'ejue?iicc,  but  eae'h  erne?  h<is  a  eliffe're^nt  argument. 
As  we  inelicated  in  See;tion  1.3  we  re?fe'r  to  such  non-re!peating  recursive 
infe?rence  as  divergent  inference.  , 

How  do  we  go  about  cutting  off  infe;rcnce  in  such  a  case?  In  ge'neral  it 
is  only  se?ini-deciel;vble  whether  e)r  ne)t  the  space  below  a  given  subgoal  will 
contain  nove'l  answers  te)  the  problem.  Yet  for  a  case  like  the  one  above  we 
can  seipply  a  fairly  siini)le  argume'iit  fe)r  pruning  the  inliuite  re'cursieni  from 
the  se'arch  space.  Suppe)se  that  the  smalle'st  integer  in  the  database  is  2. 
The  seque'iice  e)f  elescenelants  frenn  Integer{2.b)  is  mone)tonically  de?creasing. 
As  a  result,  once  we  have  passed  Integer {2)  idl  further  doscenelants  are 
superfluenis;  the'y  will  ne?ver  be  able  to  match  any  fact  in  the  elatabase. 
This  {U’gume'iit  is  ne)t  unlike'  the  .se)rt  of  arguments  used  in  ])roviug  program 
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correctness  or  program  termination.  .Here'  wc^  have  used,  as  an  invariant 
assertion,  the  fact  that  every  descendant  of  Integer  [2, h)  will  be  of  the  form 
(j>[x)  A  Integer [x)  and  that  x  will  always  be  less  than  2, 

This  kind  of  argument  can  be  generalized  to  arbitr^vry  recursive  collec¬ 
tions.  What  is  necessary  is  to  find  an  invariant  assertion  for  each  goal  form 
in  the  loop  that  implies  that  there  will  be  no  answers  in  the  database  for  the 
corresponding  goal.  In  addition  we  must  show  that  all  other  rules  that  apply 
to  goals  in  the  loop  (rules  not  in  the  recursive  collection)  will  not  produce 
any  answers. 

We  can  make  this  kind  of  argument  more  precise.  Let  the  relation  iV’o(p) 
mean  that  there  are  no  facts  in  the  database  that  unify  with  the  proposition 

P- 


Theorem  4.1  Let  {Ri^ . . .  Rm}  the  relations  occurring  in  the  consequents 
of  the  rules  in  a  cyclic  collection  (recursive  collections  included).  Let 

—  ^3\k,n{yy  A  Rj{y)  - Rk{^) 

designate  the  rule  in  the  collection  having  a  relation  Rj  in  its  premise, 
and  Rfc  in  its  consequent.  (The  <l>j,k,n  ‘tnay  contain  additional  R  from  the 
set.)  Suppose  that  there  is  a  predicate  j3k  on  the  domain  of  each  relation  Rk 
such  that 

L  (h[y)  No[^Rk{;yr), 

2.  (h[^)  A  z)  and 

S.  Pk[2)  Super fluous{^),  for  all  other  facts,  (7  Rfc{z)),  not  in 

the  recursive  collection. 

Then,  if  Pk{A)  holds,  the  goal  Rk{A)  is  ,Huperfluous, 

Hcr(^  Pk{2)  is  the  invariant  assertion  for  those  goals  with  the  relation  Rk, 
The  first  condition  states  tliat  the  invariant  assertion  assures  that  no  answers 
will  be  found.  The  second  condition  states  that  the  invariant  assertions  are 
preserved  from  a  goal  to  its  immediate^  subgoals,  and  the  third  condition 
assures  that  jiojk'  of  tlu'  exit  ])()int  s  of  tlu'  loop  will  Ic'ad  to  any  answers. 

Proof  First  we  consider  just  those  descendants  of  Rk{A)  that  can  be  gen- 
erated  using  rules  in  the  cyclic  collection.  We  want  to  show  that  there  are 
no  answers  in  the  database  for  any  of  these  descendants.  We  know  that  each 
of  these  descendants  will  contain  a  clause  Rj{y)  for  some  Rj  m  the  set  of 
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relations  described  in  the  theorem.  If  we  ean  show  that  the  invariant  asser~ 
tion  Pj{il)  holds  for  that  descendant,  condition  (1)  in  the  theorem  tells  us 
that  there  will  not  be  any  answers  in  the  database.  Thus,  we  want  to  show 
that,  for  each  descendant  g'  generated  using  only  the  cyclic  collection,  there 
is  some  expression  il){y,  z)  and  some  relation  Rj  in  the  set  so  that  g'  takes 
the  form 

g'  =  “V* {y,  2)  A  Rji^  ”  (4-2) 

and  that 

==>  PM  •  (^ "  ^) 

We  prove  this  by  induction  on  descendant  depth.  For  the  initial  goal 
Rk{A),  the  induction  hypothesis  (4-2)  holds  if  we  let  ^  be  the  empty  clause, 
y  A  and  let  j  =  k.  Likewise,  (4^2)  follows  from  the  given, 

Now  assume  (4-2)  and  (4-3)  for  every  l^^  level  descendant  of  the  goal 
Rk{A).  Any  [I  +  1)^*  level  descendant  will  be  a  subgoal  of  some  l^^  level 
descendant.  There  are  two  possible  ways  of  obtaining  subgoals  from  an  l^^ 
level  descendant  z)  A  Rj{y)^ 

1.  Apply  some  rule  to  a  clause  of  ij).  In  this  case  the  new  subgoal  will  be 
of  the  form  5)  A  Rj{y),-which  satisfies  (4‘2).  Furthermore,  since 

==>  Pj{y)  Pjiy)^ 

which  proves  the  second  half  of  our  induction  hypothesis  (4~3). 

2.  Alternatively,  we  could  apply  some  rule  Fi^j^n  lo  the  clause  Rj(y)*  In 

this  case  the  nev)  subgoal  will  he  '0(y,  A  A  Ri[x).  If  we 

let  z)  ~  y)  A  V^(y,  z)  our  subgoal  becomes  z)  A  Ri{x), 

which  again  satisfies  (4^2).  Furthermore,  since  'tl){y,z) 

Pj(y)  Pi{^')  (condition  (2)  of  the  theorem)  we  get  that 

({>ij^n(S,y)  Ai’iy.z)  Pt{x),  or  'Ip^{x,z)  =>  pi{x).  Thus  the  second 
part  of  the  induction  hypothesis  also  holds. 

The  hypotheses  (4-2)  and  (4-3)  therefore  hold  for  all  (/  +  1)^*  level  de¬ 
scendants  of  Rk(A)  and  by  induction,  for  all  descendants  of  Rk{A)  produced 
using  only  rules  in  the  cyclic  collection.  It  follows  from  condition  (1)  in  the 
theorem  that  there  will  not  be  any  answers  in  the  database  for  any  of  these 
descendants. 

What  remains  is  to  consider  those  descendants  produced  using  rules  not 
in  the  cyclic  collection.  Every  such  descendant  will  involve  either  applying 
such  a  rule  directly  to  the  goal  Rk{A),  or  to  one  of  the  goals  (l^{y,z)  ARj{y) 
generated  using  the  cyclic  collection.  Again  there  are  two  ways  of  producing 
subgoals  to  a  goal  of  the  form  z)  A  Rj{y)» 


4.1  Example 
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Therefore,  there  are  no  answers  in  the  database  for  any  of  the  descen¬ 
dants  of  Rk{z),  which  means  it  is  superfluous.  □ 

4.1  Example 

To  seo  how  this  theorem  applies,  consider  the  sinyde  integer  example  in- 
trodneed  earlier.  For  this  example  there  is  only  one  nile  in  the  recursive 
collection.  The  relation  in  its  consequent  (i?i)  is  the  Integer  i-elation,  and 
its  (f)  will  be  <f>i,i,i{x,y)  =  “y  =  x  +  1”.  If  we  choose  Pi{x)  =  “x  <  2”,  the 
condition  Pi{y)  ^  <l>i,i,i{x,y)  ==>  Pi{X‘)  will  be  satisfied.  If  the  snmJlest  inte¬ 
ger  in  the  database  is  2,  Pi{x)  N o(Ri(x))  is  true.  The  final  condition, 

that  all  rules  not  in  tlu'  recursive  colh'c  tion  result  in  superfluous  goals,  is  true 
sinc<!  th(;rc  an^  no  other  rules.  TIk'u,  according  to  the  theorem  /3i(x) 
Superfluous{‘'Ri(x)'’),  or  x  <  2  Super fluou.'i(‘'Int(;ger(x)").  There¬ 

fore,  v/e  conclude  tlnit  the  subgoal  Integer{l.5)  is  superfluous. 


Apply  some  rule  to  a  clause  of  ij).  yl.s  before,  such  a  subgoal  will  still 
satisfy  the  induction  hypothesis  and  the  previous  argument  holds. 

Apply  a  rule,  7  Rj(y)  clause  Rj{y)  to  yield  the  subgoal 

■iply,?)  A  7.  But  by  the  induction  hypothesis  we  know  that  'tp(y,z)  =>• 
Pj{y).  By  condition  (3)  of  the  theorem  we  conclude  that  7  is  superflu¬ 
ous.  Thus  there  are  no  answers  in  the  database  to  any  of  the  descen¬ 
dants  of  this  subgoal. 


4:2  Application  of  the  Theorem 

In  general,  m<M:hanizing  th('  aj)j>lication  of  Theorem  4.1  is  not  «i  simple  mat¬ 
ter.  First  we  choos(?  an  applicable!  recursive  collection  to  apply  the  theorem 
to.  It  may  be  that  all  recursive  collections  are  already  known  and  marked 
in  the  database.  In  this  case  finding  an  applicable  reemrsive  collection  is 
a  straightforward  lookup  opexation.  If  not,  we  must  recursively  enumerate 
the  sot  of  ai)i)licable  rules  looking  for  recursive  collections.  This  is  done  by 
mapping  through  each  rule  that  applies  to  a  goal  and  doing  the  same  for 
each  subgoal.  If  the  satiK*  I'ule  is  used  again  in  any  path,  a  cycle  and  pos¬ 
sible  recursive  collection  has  be('n  hx'.ated.  If  several  imh'pendent  recursive 
collections  arc  found  w(!  must  choose  one.  In  satisfying  the  final  criterion  of 
the  theorem,  that  all  other  apidicablc  rules  do  not  result  in  any  answ(!rs,  the 
others  will  be  consider(!d  (the  theorem  may  need  to  bo  applied  recursively 
to  prove  these  cases). 
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Ambiguity  in  dioosiiig  th(',  rocursiv('  collection  also  arises  wIh'ii  two  or 
more  recursive  colkxtions  sliar(!  a  common  mile.  In  this  case  we  have  nested 
or  interwoven  loops.  According  to  the  delinition  of  a  recursive  collection, 
their  union  also  constitutc's  a  recursive  collection.  We  could  therefore  choose 
to  apply  the  theorem  to  one  of  the  individual  rc'cursive  collections,  or  to 
the  composite  colh^ction.  If  we  choose;  to  apply  it  only  to  an  individual 
collection,  in  the  final  stop  it  will  be  m^cessary  to  prove  that  none  of  the 
other  interwoven  loops  can  yield  an  answ(!r.  This  is  usually  more  difficult. 
It  is  therefore  probably  wise  to  consider  the  maximal  recursive  collection 
first. 

The  second  step  is  to  collect  the  set  of  consequent  relations  in  the  recur¬ 
sive  collecdiou.  This  is  straightforward. 

The  third  step  is  to  find  a  set  of  invariants  Pi  that  satisfy  the  character¬ 
istics 

1.  Pk{z)  =>  and 

2.  Pk{z)  A  <i)j,k,n(y^  PAy)- 

This  task  involves  gciicrating  j)ossible  i)rc(licat(^s  pi  and  testing  them  to  see 
if  tliey  satisfy  the  al)()V<'  axioms.  The  most  ('llieient  way  to  do  this  is  to  start 
at  OIK'  place'  in  tlu'  loop,  and  proce'od  around  the  loop  in  an  orderly  fasliion, 
generating  the'  p  at  each  step.  Thns  we  start  by  generating  a  i)ossibility  pk 
for  some  k  and  chc'ck  to  see  that  it  satisfies  the  first  axiom  above.  Then, 
choose  j  so  that  tluTe  is  sojnc'  rnle  Fj^k,n^  Now  geiuTate'  Pj  and  tiu'ck  to  see 
that  it  satisfic's  both  the  first  and  second  axioms.  Then,  choose  z  so  that 
tlu're  is  so nu'  rnh'  Fij^n  and  so  forth. ^ 

The  i*eal  ])robl(mi  is  in  generating  good  candidates  for  any  individual  pi^ 
particularly  sinc(^  the  desired  Pi  might  b('  a  conjunction  of  known  relations. 
Wo  conld  start  by  considering  all  known  predicates  on  the  domain  Di  of 
Ri.  If  none  of  these  work,  we  could  fry  all  known  relations  from  to  a 
new  domain  D'  and  conjoin  these  with  known  predicates  on  D'.  If  none  of 
these  work,  we  consider  conjunctions  containing  thre(^  relations,  and  so  on. 
In  general  this  may  be  necessary.  Howev(T,  it  seems  that  P  often  takes  the 
form  of  an  integer  bound, 

Pi{x)  =  ‘‘^{xJ)Al^N^ 


aiul  Waldiiigor  [MW77]  discuss  more  sopbivsticjitcd  ways  of  generating  loop  in¬ 
variants  for  the  purposes  of  progrjua  verification.  Much  of  this  work  aiipotvrs  to  be 
applicable  here. 


4.3  Functional  Embedding:  A  Special  Case 


43 


where  is  one  of  <,>  or  —  and  N  is  a  fixed  integer.  In  our  simple  intc^ger 
case,  7  was  the  identity  relaidon.  However,  if  we  were  dealing  with  lists 
of  ever  increasing  length,  the  Length  function  might  be  cippropriate.  Simi¬ 
larly,  if  we  were  dealing  with  human  ancestry  a  function  such  as  Dirthdate 
might  b('  api)roi)riate.  The  stratc'gy  for  generating  (li  therefore  involves  first 
considering  an  empty  7  if  th(^  domain  of  Ri  is  the  integers.  If  this  fails, 
known  relations  mcipping  the  domain  Di  onto  the  integers  are  considered. 
In  effect,  this  is  a  way  of  generating  possible  ordering  relations  for  domains 
where  an  ordering  ndation  is  not  already  Jenown.  Although  it  may,  in  theory, 
be  necessary  to  consider  cojijunctions  of  known  relations  for  7,  if  the  num¬ 
ber  of  known  relations  is  large,  the  space  of  possibilities  quickly  becomes 
intractable  wluui  more  (*ompl(^x  7  are  considered. 

Th('  final  step  involves  verifying  tliat  none  of  the  other  relevant  facts 
will  geiKTate  any  answers  to  the  i)roblein.  This  may  be  trivial  as  in  the 
intv'ger  example,  or  it  <‘an  be  arbitrarily  difficult,  if  there  are  other  recursive 
collections  involved.  In  the  latter  case,  this  final  step  may  well  involve 
application  of  Theorem  4.1  or  any  one  of  the  cutoff  theorems  developed  in 
Section  3. 


4.3  Functional  Embedding:  A  Special  Case 

A  common  cause  of  divergcuit  inference^  are  ruh'S  that  contain  functional 
expressions  on  their  left  hand  sides.  By  this  we  mean  ruh's  of  the  form, 

P{F{x))A<l>--^  P{x)  . 

For  ('xainple,  tlui  rul(\s, 

j€wish{Mother{x))  =>  Jewish{x) 
Intc(jcr{Succcssor{x))  =>  Intcger{x) 

are  both  of  this  sort.  Such  niles  will  always  load  to  divergent  inference 
if  the  inference  engine  doe^  not  evaluate  the  emb<'<lded  functional  expres¬ 
sions.  For  example,  a  query  such  as  J cwish{J ob)  would  lead  to  the  subgoals 
J  cwish{Mothcr{J  ob)) ,  J  ewish{M  other  [M  other  (Job))),  etc. 

For  sucli  cases  we  can  often  dioose  fi  to  be  a  lower  botmd  on  the 
lcv(d  of  functional  enilxulding  in  a  subgoal.  If  there  are  no  rules  ndevant 
to  a  probhnn  that  (\in  shrink  tlu^  amount  of  functional  embedding  (e.g. 
P{f{f(x)))  =>  C^(X)),  it  is  possible  to  stop  the  inference  process  whenever 
the  lev(d  of  functional  emlxHlding  exceeds  the  largest  embedding  available 
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ill  the  (latabfise.  For  example,  in  the  Jewish  ancestry  problem,  if  the  fact 
with  the  hirgest  functional  embedding  is  j€wish{Mothcr{M  other  {Job))), 
any  subgoal  having  a  functional  embedding  dei'per  than  two  could  be  dis¬ 
carded.  Notice  that  this  strategy  refers  to  total  functional  embedding  inde¬ 
pendent  of  the  actual  functions  involved.  The  reason  is  that  there  may  be 
rules  available  such  as  P{G{x))  =»  P{F{x))  that  can  result  in  new  subgoals 
having  different  embedded  fimetions. 

4.4  Commutivity  of  Inference  Steps 

In  the  previous  section  we  considered  only  cases  where  it  was  possible  to 
jirove  that  no  .answers  existed  in  a  portion  of  the  search  space,  hi  fact  we 
can  gi'iieralize  Theorem  4.1  by  only  insisting  that  subgoals  contributi;  no 
novel  answers  to  the  overall  problem  (as  opposed  to  no  answers  at  all).  It 
is  usually  quite  difficult  to  prove  that  answers  gi'iieratiul  somewhere  in  a 
loop  will  not  result  in  novel  answers  to  the  overall  go.al.  However,  there  are 
special  cases  where  redundancy  can  bo  proven,  mid  in  such  cases  Theorem 
4.1  can  be  applied.  In  this  section  we  develop  such  a  sjxjcial  case  r(!sult  for 
situations  where  the  inference  stops  are  commutative. 

Consider  the  p.air  of  axioms: 

Ri  :  y  =  x  + I  A  Integer  (x)  Integer  {y) 

i?2  :  y  —  X  -  2  A  Integer  {x)  Integer  [y) 

As  before,  suppose  th.at  the  jiroblem  is  to  determine  whether  or  not  2.5  is 
an  integi'r,  and  the  smallest  integer  in  tlu*  dat.abase  is  2. 

When  only  tlu'  lirsl.  of  the  abovi'  two  rules  was  available,  we  argued 
tlmt  the  seipience  of  subgo<vls  from  lnteger[I.h)  w.is  monotoiiically  dei  reas- 
iiig,  and  therefore  the  subgoal  Integer was  sujierfluous.  Given  both 
rules,  this  argument  no  longer  holds,  since  Integer{Z.5),  Intcger[b.b),. . . 
are  now  descondiuits  of  the  subgoal  Integer(l.5).  In  fact,  inuiginc  that 
the  fact  Integer  {b. 5)  h.apiiciK'd  to  be  in  the  data  bfvsc.  Then,  the  subgoal 
Integer(L.b)  would  not  bo  superfluous,  since  the  problem  could  be  solved  by 
exploring  one  of  its  descendants. 

Even  though  the  goal  Integer{l.b)  nmy  not  be  superfluous,  we  can  ar¬ 
gue  that  it  is  redund.uit  with  its  sui)ergo<al.  Integer {2. b).  The  ai'gument 
depends  on  the  observation  that  any  ajiplication  of  the  two  rules  above  is 
commutative.  In  other  words,  if  a  subgoal  can  be  produced  by  applyuig  one 
rule,  then  the  other,  it  can  .also  be  jiroduced  by  .applying  the  niles  in  the 
reverse  order.  For  example,  the  subgoal  Integer [Z.b)  can  be  produced  from 
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the  goal  Intcger{2.5)  by  applying  followod  by  i?2-  Altoniativc'ly,  it  can 
be  produced  by  ai)plyiug  R2  followed  by  Ri. 

Using  this  observation,  we  sep^irato  the  descendants  of  Integer  {i.b)  into 
two  groups,  those  generated  by  applying  only  the  first  of  the  two  rules,  and 
those  that  involve  at  l(?ast  one  ai)plication  of  the  second  rule.  From  our 
earlier  argument  we  know  that  the  first  class  will  not  result  in  miy  answers. 
For  th(i  s('cond  class,  since  the  two  rules  arc  commutative,  the  same  subgoal 
can  be  produced  by  first  applying  the  second  rule  to  the  goal  Integ€r{2.5). 
Thus  the  subgoal  Intcgcr[l.b)  is  redundant. 

We  now  make  this  kind  of  alignment  precise.  We  say  that  two  sets  of 
rules  are  commutative  if  any  subgoal  produced  using  a  rule  from  one  set 
followed  by  a  rule  from  the  other  set  could  also  be  produced  by  using  the 
nilcs  in  the  opposite  order.  More  formally. 

Commutative t)  Vr/  G  s,  r  E  (7,  g\  h 
{Subgoalg(g,  g*)  A  Subgoalr{g\h) 

=>  3g*^ Subgoalr{g,  g^^)  A  Subgoal q{g^*  Ji)) 

where  the  notation  Subgoalr{g,  h)  iiioans  that  the  goal  h  can  be  derived  as 
a  subgoal  of  the  goal  g  using  the  rule  r. 

Theorem  4.2  Suppose  that  the  set  of  applicable  facts  for  a  goal  g  can  be 
broken  up  into  two  cojnTtiutative  subsets  s  and  t.  Suppose  that  all  descen¬ 
dants  of  g,  generated  using  only  rules  in  s,  produce  no  novel  answers  fi,e. 
if  only  rules  in  s  are  used,  the  subgoal  g  ivould  be  redundant).  Then,  all 
(immediate)  subgoals  of  g  produced  using  rules  in  s  are  redundant  for  the 
entire  collection  s\Jt. 

Proof  Let  g*  be  an  (immediate)  suhgoal  of  g  generated  using  a  rule  from 
the  set  s.  Consider  an  arbitrary  descendant^  d,  of  Suppose  d  is  produced 
using  only  the  rules  in  the  set  s.  Then,  by  the  premises  of  the  theorem  there 
are  no  answers  in  the  database  for  d  that  result  in  novel  answers  to  the  overall 
problem.  Alternatively,  suppose  that  d  is  produced  using,  at  least  one  rule  r 
from  the  set  t.  Since  the  rules  in  s  and  t  are  commutative,  the  descendant 
d  will  also  be  a  descendant  of  the  suhgoal  f/"  generated  by  applying  r  to  the 
goal  g.  All  descendants  of  g*  (including  g*  itself)  are  therefore  redundant 
with  immediate  subgoals  of  g  produced  using  rules  in  t.  Since  our  choice  of 
g*  was  arbitrary  all  immediate  subgoals  of  g  produced  using  rules  in  s  are 
redundant.  □ 
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Integer  (2.5) 


Integer  (1.5)  Integer  (4.5) 

'  (redundant) 

Integer  (3.5)  Integer  (.6.5) 
(redundant) 

Integer  (2. 5)  Integer(5.5) 
(stil)sumed)  (redundant) 


Figure  4-2:  Search  space  for  the  query  Integer(2.5).  The  first  conjunct  has 
been  evaluated  and  rcinov('d  from  each  subgoal 


4*5  Example 

Using  the  tluioreni  abov<',  together  with  the  r(\sults  of  previous  sections,  the 
two  rul('  integer  cxauipk^  can  now  be  handled. 

There  are  two  iinuK'diate  subgoals  of  the  goal  Intcger(2.5).  The  first, 
Intcgcr(l.5}  is  redundant  according  to  Theorejns  4,2  and  4.1.  Therefore,  it  is 
possible  to  eliminate'  it  without  sacrificing  any  answers.  The  other  subgoal, 
Integcr(4.5).  has  the'  two  immediate  snbgoals  Intf:gcr(3.5)  and  Integcr(6.5). 
If  the  maximum  iiit('g<T  in  l.he  database'  is  3,  w<*  can  again  ap])ly  Theorenns 
4.2  anel  4.1  to  show  that  I?itegcr(C).5)  is  re'elundant.  The'  othe?r  subge)al, 
Intcgcr(3.5)  has  the  two  imme'difite  snbge)als  Integer(2.5)  and  Intcger(5.5). 
The  latte^r  is  again  reelundant,  by  a])plication  of  The'orems  4.2  and  4.1.  The 
rennaining  subgoal  Integcr(2.5)  is  idemtical  to  the  endginal  goal,  tUid  so  by 
Thcorenn  3.9  it  can  alse)  be  climinatoel.  The  abbreviated  subgoal  tree  is 
she)wn  in  Figure  4-2. 

It  is  inte^resting  to  ne)te  that  if  we  changed  the  constant  in  either  of  the 
twe)  rule's  to  an  irrational  numbe'r,  llu'  infe're'iice'  e*ou1el  not  be  e‘e)rnpl('t('ly 
stoppe'el.  We  coulel  still  apply  The'e)reins  4.2  and  4.1  at  t'ach  le'vel  of  the 
se'arch  space,  but  we  would  never  re'turn  to  the  e)riginal  ge)al,  and  therefore 
could  iiewe'r  a])j)ly  The'orem  3.9.  In  this  e.aso,  the  e-hain  of  subgoals  would 
continue  to  bounce  ba<‘k  anel  fe^rth  be'twe'e^n  the  two  c'xtreme  integers  in  the 
database. 
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4.6  Remarks 

> 

In  this  section,  we  first  developed  a  general  theorem  for  terminating  diver¬ 
gent  inference,  and  used  it  to  solve  a  simple  problem  involving  a  single  loop. 
We  also  applied  the  theorenn  to  the  spwial  case  of  fiinctional  embedding. 

It  is  geiKTally  more  difficult  to  apply  the  theorem  to  cases  of  redundancy, 
as  we  can  sc(!  from  the  two  nile  integer  example  above.  Powerful  special  case 
methods  like  Theorem  4.2  seem  essential  for  dealing  with  such  complex  cases. 
We  have  investigated  only  one  such  result  here.  Additional  work  is  needed 
to  build  up  a  library  of  theorems,  like  4.2,  that  can  be  used  for  various 
difficult  cases  of  divergent  inference. 
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5  Discussion 

5.1  Detecting  Recursive  Inference 

There  is  always  a  i)rico  to  peiy  for  rontrolling  inforonco  and  control  of  recur¬ 
sive  infer<Mice  is  no  exc<'])tion.  For  repeating  inference  the  cost  is  relatively 
low.  It  involves  suspension  of  repeating  goals  and  the  caching  of  answers 
to  goals  with  repeating  subgoals.  How('ver,  for  divergcuit  inference,  control 
involves  explicit  proofs  that  subspaces  arc  superfluous  or  redundant.  When 
the  alternative  is  an  inlinite  loop,  any  finite  control  cost  is  justifiable.  The 
problem  is,  we  usually  cannot  be  certain  whether  or  not  an  infinite  loop  will 
result.  As  we  pointed  out  in  Section  2,  even  when  a  problem  has  an  infinite 
recursive  search  space,  recursive  inference  will  not  ncci'ssarily  occur.  The 
necessary  answers  might  be  found  before  an  infinite  path  is  explored  by  the 
inference  engine. 

In  general,  it  is  undecidable  wlu'ther  or  not  a  given  inference  procedure 
will  terminate  when  searching  a  nnuirsive  si)acc.^  The  best  that  can  be 
done  is  to  institute  control  only  when  it  is  considerc'd  likely  that  it  will  be 
necessary  or  cost-efr(x  tive.  This  geiK'ial  issue  is  discussed  further  in  [Sini85|. 
For  rt'cursive  inference'  then'  are  sevc'ral  inte'resting  strategic's.  The  simplest 
is  to  monitor  sewch  dei)th  or  total  search  space'  size  aiiel  institute  cemtrol 
whe'ii  it  e'xce'e'els  se)ine'  thre'shedel.  A  irie)r('  e'labe)rate,  but  mem'  ce)stly  scheme 
is  to  j)re'S('rve'  the'  subge)al  and  justi(icatie)n  tre'es  and  institute'  erontrol  wlu'ii 
a  give'!]  fact  has  be'e'ii  use'el  more  ihan  some  lixenl  number  e)f  times  in  the 
ele'rivation  e)f  a  particular  subgoal.  A  thirel  alte'rnative  is  to  limit  enuitrol 
te)  those'  case's  wlu're  a  re'etursive'  <e)lle'ctie)n  is  involve'el  in  the'  de'eluctiem. 
(Re'cursive  ce)lle'cti()iis  e  e)ulel  be  re'cognized  eitheu-  whe'ii  rulers  are  e'ntereMl  into 
the  syste'in,  e^r  eluring  the'  j>re)ble'ni  solving  process.) 

Each  of  the  strate^gie^s  has  ce'rtaiii  aelvantage\s  and  elisadvantages.  In 
ge^iHTal,  they  trade  accuracy  fen*  e'xpe'iise.  Fe>r  e'xample?,  the?  re?ce)giiition  of 
rule?  reuse?  is  usually  a  more  accurate  pre?elictor  of  ree*ursive  infere'iice  than 
overall  search  depth,  but  it  is  alse)  niem'  expe?nsive  since  it  reeiuire's  keeping 
the  goal  and  justificatieuj  stacks  anel  se'arcliing  them  for  each  new  subge)al.® 
As  a  re'sult,  the  be'st  strate'gy  fen*  a  give'ii  ap[)Hcation  will  de'])e'nel  upeni  such 

^Thc  i>r()l>lciii  is  equivalent  to  tlic^  halting  j)robloiu  for  Turing  machines  since  backward 
iiif<^rciic(^  over  a  set  of  jixioiiLs  is  Turing  cqiiivahiut. 

*  Associating  a  marker  or  counter  with  each  rule  doesn’t  work  in  general.  The  marker 
would  have  to  be  path  dependent  since  wc  do  not  wish  to  count  the  rejjeated  usage  of 
rules  in  iiid(q)end(nit  inference  ])aths. 
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things  ns  the  average  dc])th  of  inference,  th('  freciiiency  of  recursive  inference, 
and  the  density  of  recursive  collections  in  the  system’s  databiise. 

There  is  also  no  reason  why  these  stratogi(!S  cannot  be  combined.  For  ex¬ 
ample,  we  could  use  soivrch  spa(;o  depth  or  complexity  to  determine  whether 
or  not  to  initiate  the  strategy  of  che(-king  for  n'cursive  collections  or  repeated 
rules.  Likewise,  the  st.rat(;gy  of  ch('cking  for  n^peated  rules  coidd  be  used  as 
a  filter  for  the  strategy  of  looking  for  recursive  collections.  These  combined 
strategies  allow  a  less  eoepensive  but  less  accurate  detection  criteria  to  serve 
as  a  filter  for  a  more  accurate  and  more  (‘ostly  one.  Such  combinations  may, 
in  fact,  prove  to  be  the  most  cost-efiectiv(!  for  many  applications. 

5.2  History  and  Related  Work 

5.2.1  Recursive  Inference 

Black  [Bla68]  and  McKay  and  Shai)iro  [MS81]  describe  algorithms  for  stop¬ 
ping  rop('ating  inferc'iice  similar  to  those  developed  in  Section  3.2.2.  How¬ 
ever,  they  do  not  provide  ;iny  proof  that  the  i)niuing  strategy  is  correct  and 
do  not  consider  the  (pu'sl  ion  of  oi)timality.  Tlu'y  also  do  not  consider  any 
of  the  sp(>cial  cases  (like  transitivity,  subsuiiK'd  subgoals,  or  single  answer 
queric's)  wh('r('  more’  powc'i’ful  strat(?gies  can  be  us(h1. 

The  sj)ecial  case  of  eliminating  icU'nl  iciil  subgoals  appears  to  have  been 
first  used  by  (leh'ruter  in  his  gaunetry  theorc'm  luoving  program.  [CelCS]. 

Sithf^onls  ...  an'  rejected  ...  that  appear  as  higher  suhgoals 
oil  the  /snhgoalj  grapii  (or  are  syittaetically  symmetric  to  some 
higher  suhgoai).  page  142 

In  (l('l<>rnti’r’s  application  sinc('  all  goals  and  sid)g<)als  an'  g(!ometry  theorems 
retpiiring  only  a  yes  or  no  answer  both  Theorems  3.1  and  3.9  apply.  As  a 
result,  all  rejx'ated  subgoals  can  be  ('liminaU'd  lor  this  particular  ai>plication. 

Special  cases  of  re])eatiiig  inference  W(Te  also  encouuter('d  in  building 
the  MYCIN  system  [Sho84].  One  cause  of  repeating  subgoals  in  MYCIN  was 
th(!  use  of  solf-rcfercnrivg  rules.  A  s('lf-refereiicing  nde  state's  that  if  there  is 
already  ('vidence  for  a  condition  V  Jviid  some  otluT  condition  (/>  holds,  there 
is  additional  t'vuh'iice  for  the  couditioii  ij).  These  rules  tlierc'fore  include?  the 
proj)osition  if)  in  both  the?  premise  and  couclusieui.  MYCIN  handle's  a  se'lf- 
refere'nciiig  rule'  by  postpe)ning  it  until  all  e)the;r  rule's  fen-  cemedudiug  ij)  have 
been  used.  The'ii,  the'  se^lf- referencing  rule'  is  applie?el  exae  tly  once. 

This  strate'gy  inve)lve'S  i)rimiug  all  re'pe'ate'd  api)licatie)ns  e)f  a  rule,  a  much 
stronge'r  pruning  strategy  than  is  inelie’ale^el  by  Thoe)reMn  3.3.  This  strategy 
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works  for  s('lf-referoiicing  nilos  b('caus(>  they  are  actually  quite  difhjrent  from 
I’ecursive  rules.  Consider  how  we  would  translate  a  self-referencing  rule  into 
a  precise  declarative  statement.  W(5  might  be  inclined  to  write  something 
like 

Ip  Ip 

where  means  that  we  have  p  additional  evidence  for  the  conclusion  (the 
actual  calciilus  for  combining  certainties  is  unimportant).  If  this  statement 
were  true,  given  some  small  amount  of  evidence  for  mid  the  fact  that  <p 
is  true,  we  could  use  this  axiom  over  and  over  again  to  derive  greater  and 
greater  belief  in  ip.^  This  is  not  the  intended  meaning  of  the  self-referencing 
rule.  In  a  self-referencing  rule  the  recursive  premise  is  a  screen  to  prevent 
exploration  of  (p  unless  tlu^re  is  already  some  evidence  of  ip.  In  other  words, 
the  recursive  promise  is  control  knowledge  about  when  to  apply  tin;  simpler 
rule 

i  =>p  Ip  . 

Thus  a  logiciil  translation  of  a  self-rcTerencing  rule  would  consist  of  two  rules; 
the  simph’  rule  given  above,  and  a  control  ruh*  indicating  that  the  above 
rule  should  not  be  tried  unless  there  is  already  evidence  for  ip.  Neither 
of  these  rules  are  recursivi;  so  th(>  tlu'orerns  developed  in  Section  3  do  not 
apply.  This  translat  ion  also  shows  why  MYCIN’s  prmiing  strategy  for  self- 
refcTcmciug  rules  is  appropriate.  Since  th('  above  rule  is  not  recursive,  it  need 
be  ap])li('d  only  onc(\ 

Ih'peatiug  inhireuce  also  occurs  in  MYCIN  ;us  a  n'sult  of  nde  loops.  For 
example,  a  ruh*  miglit  allow  a  paramc'tcir  D  to  be  iuferr('(l  from  a  j)arametcr 
A,  while  auothiu-  ruh'  might  allow  A  to  lx-  inferred  from  D.  MYCIN’s  strategy 
in  such  ciis(!s  is  to  u(>v('r  use?  a  ruh?  mon?  than  once  in  a  siiigh*  reasoning  chain. 
This  is  equivalent  to  pruning  cdl  rejujating  subgoals.  This  works  bwause, 
once  the  context  is  bound,  the  premises  and  conclusions  of  such  rules  are 
gromid  clauses.  Thus,  as  in  (loh'rnter’s  application,  the  powerful  pnining 
strategy  of  Theorem  3.9  applies. 

More  recently,  Minker  and  Nicolas  [MN83]  have  developed  a  .spc'chd  case 
of  Corollary  3.9  and  have?  shown  that  for  the  class  of  “singular”  recursive 
rules  all  repc^atiiig  subgoals  will  be  subsuiiH'd  and  can  th(Teft)r('  be  elimi¬ 
nated. 

®It  is  iiitor(?8t,inK  to  note  thnt,  Theorem  3.1,  as  statetl,  will  not  hold  in  tlie  case  of 
tiuccrlaiii  rcjvsoiiing.  Evoii  if  tj)  is  a  ground  clauso,  recursion  could  coiitinno  to  increase 
the  ])dicf  in  V'-  However,  from  an  evidential  i)oint  of  view  we  would  never  want  to  allow 
this,  since  arguments  should  not  be  circular. 
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Other  approaches  to  controlling  rei)eating  inference  have  also  received 
some  attention,  altliough  the  results  have  been  limited  to  special  cases.  Re¬ 
iter  [Rci78]  and  Minkcr  and  Nicolas  [MN83]  have  shown  conditions  where  it 
is  possible  to  use  only  forward  inference  on  recursive  collections.  Automatic 
reformulation  of  recursive  collections  has  been  explored  by  Chang  [ChaSO] 
and  Naqvi  and  Henschen  [NH80].  They  describe  methods  of  automatically 
generating  efficient  procedures  for  the  special  class  of  “regular”  recursive  col¬ 
lections.  Minker  and  Nicolas  [MN83]  have  shown  that  this  method  applies 
to  a  slightly  broader  class  of  recursive  collections.  A  somewhat  different  ap¬ 
proach  to  control  is  that  advocated  by  Ullman  [111184] .  Ullman  first  analyzes 
the  soaixh  space  for  queries  of  a  given  form  (given  relation  and  given  set  of 
bound  and  free  variable's)  to  find  potcmticil  recursive  paths.  He  then  uses  this 
information  to  avoid  such  paths  during  the  nvasoning  process.^®  The  most 
serious  problem  with  this  approach  is  that  it  can  result  in  incompleteness 
for  queries  that  recpiirc  some  amount  of  recursive  inference.  It  is  also  not 
clear  that  the  approach  holds  any  advantage  ovc^r  algorithms  like  those  in 
Section  3.2.2. 

The  more  difficult  problem  of  divergent  infcrc'iice  has  receiv('d  little  at¬ 
tention  in  the  literature.  Fisclier  Black  noted  the  problem  in  devedoping 
his  natural  deduction  system  [Bla68]  but  provides  no  solution  other  than 
d(q)th-limited  search. 

Problems  of  recursive  infc'rejice  hav(^  also  arisen  outside  of  the  Artificial 
Intelligence  community.  Both  repeating  and  divergc'iit  infi'rence  are  constant 
obstacle's  in  the  construction  of  PR()LO(i  i)rograms.  Users  of  TUtOLOG  barome 
well  versc'd  in  manual  n'formulation  of  nih's  to  ('liniinato  infinite  loops.  As 
we  illustrated,  this  is  not  always  an  easy  task  and  the  resulting  programs 
can  be  quite'  e)paque. 

Recently,  at  Staiife)rd  we  have  encountered  re'i)e'ating  anel  elive^rgent  in- 
ievcixce  in  the  constructie)n  of  syste'ins  for  reasoning  about  digital  circuits 
[Ge'n85,Kra84].  The  teehniques  doscribeel  here  are  benng  implemented  in  an 
expeirimental  version  of  the  MRS  system  [Rus85]. 

5.2.2  Program  Verification 

Tlx're^  is  a  stremg  similarity  be'tween  re'cursive'  infe're'uce  and  re'cursive  pro¬ 
grams  that  ele)  not  te'rminate.  In  essence,  an  infe're'iice  procedure  together 
with  a  goal  and  recursive  collection  of  facts  is  a  re(uirsiv(i  program.  Thus, 

*”Th('  approach  boars  somo  resemblance  to  that  for  controlling  backwtxrd  inference  in 
[SniiSSj.  In  fact  Ullinjui’s  approach  jdso  api)lie8  to  more  thmi  just  recursive  inference. 
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it  should  come  as  no  surprise  that  the  technique's  for  deciding  whether  a 
given  inference  path  terminates,  loops,  or  diverges,  bear  a  striking  resem¬ 
blance  to  the  method  of  well-founded  sets  used  to  prove  program  termination 
[Flo67,Man74], 

But  the  similarities  end  here.  In  general,  a  recursive  program  that  does 
not  terminate  is  of  little  use.  It  must  be  modified  so  that  it  does  terminate. 
Doing  this  requires  some  understanding  of  the  intention  behind  the  program. 
In  contrast,  a  recursive  collection  of  facts  has  meaning,  independent  of  the 
particular  inference  engine  being  used.  In  this  case,  the  inference  engine 
must  be  modified  so  that  it  will  perform  the  proper  deductions.  The  intent 
of  the  inference  procedure  is  known.  Thus,  the  change  takes  the  form  as 
information  about  how  to  prune  the  search  space.  In- short,  a  program 
that  does  not  terminate  may  b(j  incorrect  in  <ui  arbitrary  maiim^r,  while 
an  inference  engine'  that  loops  (for  a  given  goal  and  recursive  colli'ction)  is 
incorrect  in  a  very  specific  way;  it  explores  too  much  of  the  search  space. 

5.3  Final  Remarks 

The  control  of  recursive  infenmee  involves  demonstrating  that  portions  of 
a  s('arch  space  are  either  supi'rfluous  or  redundant.  When  eitlu'r  of  these 
propcTties  has  been  demonstrated,  th('  offending  portion  of  the  search  space 
can  b('  discarded.  Although  this  will  always  Ix'  logically  correct,  it  may  not 
b('  oj)timal  in  every  case. 

Proofs  of  n'dundancy  and  su])(TfIuity  involve  knowh'dgi^  about  the  con¬ 
tents  of  lh('  system's  database',  and  about  projx'rtie's  of  Mie  relations  involved 
in  the  inference,  such  as  ordering  n'lations  on  tlx'  domains,  monotonicity, 
boundedness  and  cominutiviiy.  This  kind  of  information  is  commonly  avail- 
abl('  but  has  rarely  bec'ii  needed  or  tisc'd  in  AI  systems.  In  contrast  to 
the  g('neral  doinain-dep('nd(mt  charact('r  of  the  (’ontrol  i)roblem,  tlx?  special 
case  of  n'peating  infi'rencc  admits  control,  which  is  domain-iixlepcndent. 
The  nu'thod  of  suspt'iiding  and  r(?enabling  n'pi'ated  subgo^als  <l(x?s  not  de¬ 
pend  ui)on  the  ux'aning  of  the  symbols  involved.  It  is  not  (?ntir<'ly  clear  why 
this  fortuitous  result  sluxild  hold.  It  is  true  however,  that  in  some  cases  the 
more  geix'ral  domaiu-d('p<'nd(?nl  t('chni(|U('S  of  ])roof  can  lead  to  more  severe 
j)runing  for  n'i)eal<ing  infereiu-e  than  is  ])ossible  with  the  syntactic  nu?thod 
of  Section  3. 

Det(?rmining  wheth(?r  or  not  recursive  inference  will  occur  for  a  given 
problem  is  in  general  uiidecidable.  We  have  suggested  three  ])ossiblc  crite¬ 
ria  for  d('terminiiig  when  control  of  recursive  infen'uce  should  be  instituted; 
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inference  depth  or  complexity,  repeated  rule  usage,  and  the  use  of  recur¬ 
sive  collections.  Combinations  of  these  approaches  also  appear  promising, 
although  the  decision  will  almost  certainly  prove  dependent  upon  the  mix 
of  problems  encountered  in  any  particular  application. 

Finally,  there  is  no  a  priori  reason  why  the  techniques  of  proving  rcdim- 
dancy  .-uid  superfluity  could  not  be  applied  to  non-rc'cursive  inference.  The 
limiting  factor  is  cost.  When  an  infinite  search  is  avoided,  a  high  cost  is 
justifiable.  However,  for  non-recursive  inference  the  problem  would  have  to 
be  a  dillicult  one  for  expensive  analysis  like  that  of  Section  4  to  be  cost- 
effective.  For  such  cases,  complex  monitoring  strategies  like  those  proposed 
in  Section  5.1  would  be  indispensable. 
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